Sep 07 22:55:12.144384 ip-10-0-136-182 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 07 22:55:12.144396 ip-10-0-136-182 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 07 22:55:12.144402 ip-10-0-136-182 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 07 22:55:12.144550 ip-10-0-136-182 systemd[1]: Failed to start Kubernetes Kubelet. Sep 07 22:55:22.394063 ip-10-0-136-182 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 07 22:55:22.394080 ip-10-0-136-182 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d8000855a7c3411faad96debb596e3b3 -- Sep 07 22:56:54.391514 ip-10-0-136-182 systemd[1]: Starting Kubernetes Kubelet... Sep 07 22:56:54.821706 ip-10-0-136-182 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 22:56:54.821706 ip-10-0-136-182 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 22:56:54.821706 ip-10-0-136-182 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 22:56:54.821706 ip-10-0-136-182 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 22:56:54.821706 ip-10-0-136-182 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 22:56:54.824101 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.824007 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 22:56:54.830615 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830597 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 22:56:54.830615 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830614 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 22:56:54.830615 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830617 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830621 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830624 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830627 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830630 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830633 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830638 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830642 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830645 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830648 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830651 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830654 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830660 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830663 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830666 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830669 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830671 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830674 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830676 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830679 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 22:56:54.830745 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830682 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830684 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830687 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830689 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830692 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830695 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830697 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830700 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830703 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830705 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830708 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830711 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830714 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830716 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830721 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830723 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830726 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830728 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830731 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830733 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 22:56:54.831490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830737 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830739 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830742 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830744 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830747 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830750 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830753 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830756 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830758 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830761 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830764 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830766 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830769 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830771 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830774 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830776 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830780 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830784 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830786 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830789 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 22:56:54.832213 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830791 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830794 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830797 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830799 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830802 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830806 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830809 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830812 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830814 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830817 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830819 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830822 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830824 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830827 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830829 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830832 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830834 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830838 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830842 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 22:56:54.832957 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830845 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830848 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830851 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830854 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830857 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830859 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830862 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830864 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830867 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830869 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830873 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830876 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830879 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830881 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830884 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830886 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830889 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.830892 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831627 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 22:56:54.833704 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831633 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831636 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831639 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831642 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831644 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831648 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831650 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831653 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831655 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831658 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831661 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831663 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831666 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831670 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831672 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831676 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831680 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831683 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831685 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 22:56:54.834409 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831688 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831690 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831693 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831695 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831698 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831701 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831704 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831706 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831709 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831711 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831714 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831716 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831720 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831722 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831725 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831727 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831730 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831733 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831735 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831738 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 22:56:54.835129 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831740 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831742 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831745 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831747 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831750 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831752 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831755 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831758 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831760 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831763 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831766 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831769 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831771 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831774 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831778 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831781 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831785 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831788 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831791 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 22:56:54.835889 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831794 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831796 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831799 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831801 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831804 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831807 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831809 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831812 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831814 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831817 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831819 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831822 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831824 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831827 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831829 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831832 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831834 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831837 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831839 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831842 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 22:56:54.836732 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831845 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831848 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831850 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831855 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831859 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831862 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831865 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831867 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831870 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831873 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831875 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831878 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831881 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831884 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831886 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831889 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831891 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831894 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831897 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.831900 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 22:56:54.837498 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832291 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832296 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832299 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832302 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832305 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832308 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832311 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832313 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832316 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832319 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832321 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832324 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832326 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832330 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832334 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832338 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832341 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832344 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832346 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 22:56:54.838253 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832349 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832352 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832359 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832362 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832364 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832366 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832369 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832371 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832374 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832376 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832382 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832384 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832387 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832390 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832392 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832395 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832397 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832400 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832402 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 22:56:54.838952 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832406 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832410 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832413 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832415 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832418 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832421 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832424 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832427 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832430 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832432 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832435 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832438 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832441 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832443 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832445 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832449 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832452 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832455 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832458 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832460 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 22:56:54.839672 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832463 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832465 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832468 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832472 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832474 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832477 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832479 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832482 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832484 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832487 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832489 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832492 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832494 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832498 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832500 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832503 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832505 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832508 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832510 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832513 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 22:56:54.840413 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832515 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832519 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832521 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832524 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832526 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832528 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832531 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832534 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832536 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832539 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832541 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832544 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832546 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832549 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832551 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832556 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832558 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832561 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832563 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832567 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 22:56:54.841185 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.832571 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832645 2575 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832680 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832688 2575 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832692 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832697 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832700 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832704 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832709 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832713 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832716 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832719 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832723 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832726 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832730 2575 flags.go:64] FLAG: --cgroup-root="" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832733 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832736 2575 flags.go:64] FLAG: --client-ca-file="" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832739 2575 flags.go:64] FLAG: --cloud-provider="external" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832742 2575 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832746 2575 flags.go:64] FLAG: --cluster-domain="" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832749 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832752 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832756 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832759 2575 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 22:56:54.841931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832763 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832766 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832769 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832774 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832777 2575 flags.go:64] FLAG: --contention-profiling="false" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832780 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832783 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832786 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832790 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832794 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832796 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832799 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832802 2575 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832805 2575 flags.go:64] FLAG: --enable-server="true" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832808 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832811 2575 flags.go:64] FLAG: --event-burst="100" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832814 2575 flags.go:64] FLAG: --event-qps="50" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832817 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832820 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832823 2575 flags.go:64] FLAG: --eviction-hard="" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832827 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832829 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832832 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832836 2575 flags.go:64] FLAG: --eviction-soft="" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832838 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 22:56:54.842799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832842 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832844 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832849 2575 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832852 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832854 2575 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832857 2575 flags.go:64] FLAG: --feature-gates="" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832861 2575 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832864 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832867 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832870 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832874 2575 flags.go:64] FLAG: --healthz-port="10248" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832877 2575 flags.go:64] FLAG: --help="false" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832880 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-136-182.ec2.internal" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832883 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832886 2575 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832889 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832892 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832896 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832899 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832901 2575 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832904 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832907 2575 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832910 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832913 2575 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 22:56:54.843770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832916 2575 flags.go:64] FLAG: --kube-reserved="" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832919 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832922 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832925 2575 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832927 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832930 2575 flags.go:64] FLAG: --lock-file="" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832933 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832936 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832940 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832945 2575 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832950 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832953 2575 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832956 2575 flags.go:64] FLAG: --logging-format="text" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832959 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832962 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832965 2575 flags.go:64] FLAG: --manifest-url="" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832968 2575 flags.go:64] FLAG: --manifest-url-header="" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832972 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832976 2575 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832980 2575 flags.go:64] FLAG: --max-pods="110" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832983 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832986 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832989 2575 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832992 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832995 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 22:56:54.844673 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.832998 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833001 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833008 2575 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833011 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833014 2575 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833017 2575 flags.go:64] FLAG: --pod-cidr="" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833020 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833025 2575 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833028 2575 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833031 2575 flags.go:64] FLAG: --pods-per-core="0" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833034 2575 flags.go:64] FLAG: --port="10250" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833037 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833040 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05ef297cf44fa89dc" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833043 2575 flags.go:64] FLAG: --qos-reserved="" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833046 2575 flags.go:64] FLAG: --read-only-port="10255" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833049 2575 flags.go:64] FLAG: --register-node="true" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833052 2575 flags.go:64] FLAG: --register-with-taints="" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833055 2575 flags.go:64] FLAG: --registry-burst="10" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833059 2575 flags.go:64] FLAG: --registry-qps="5" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833062 2575 flags.go:64] FLAG: --reserved-cpus="" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833065 2575 flags.go:64] FLAG: --reserved-memory="" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833069 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833072 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833081 2575 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833085 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 22:56:54.845604 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833088 2575 flags.go:64] FLAG: --runonce="false" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833090 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833094 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833097 2575 flags.go:64] FLAG: --seccomp-default="false" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833100 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833102 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833105 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833108 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833112 2575 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833115 2575 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833117 2575 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833121 2575 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833123 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833126 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833129 2575 flags.go:64] FLAG: --system-cgroups="" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833132 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833137 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833139 2575 flags.go:64] FLAG: --tls-cert-file="" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.833142 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.834624 2575 flags.go:64] FLAG: --tls-min-version="" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.834630 2575 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.834633 2575 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.834637 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.834641 2575 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.834645 2575 flags.go:64] FLAG: --v="2" Sep 07 22:56:54.846584 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.834658 2575 flags.go:64] FLAG: --version="false" Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.834663 2575 flags.go:64] FLAG: --vmodule="" Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.834671 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.834675 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834888 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834892 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834896 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834899 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834902 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834905 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834909 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834912 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834914 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834917 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834921 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834925 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834932 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834935 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834938 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 22:56:54.847563 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834942 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834945 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834948 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834950 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834953 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834956 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834958 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834961 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834964 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834969 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834972 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834974 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834979 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834983 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834985 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834988 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834991 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834994 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.834996 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835000 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 22:56:54.848274 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835003 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835018 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835021 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835024 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835026 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835030 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835032 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835035 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835038 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835040 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835043 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835046 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835048 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835051 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835057 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835059 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835062 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835065 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835067 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835070 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 22:56:54.849015 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835072 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835075 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835078 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835082 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835085 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835090 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835093 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835098 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835101 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835104 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835106 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835111 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835114 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835117 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835119 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835122 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835125 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835127 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835130 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835136 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 22:56:54.849844 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835139 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835141 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835144 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835147 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835150 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835153 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835155 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835158 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835161 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835163 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835166 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835169 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835174 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835177 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835179 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835182 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835185 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835188 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835191 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835194 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 22:56:54.850580 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835197 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835200 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835203 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.835208 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.835918 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.843821 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.843837 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.843854 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.843860 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843916 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843921 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843925 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843930 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843934 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 22:56:54.851490 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843938 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843941 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843944 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843947 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843951 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843953 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843956 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843959 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843962 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843965 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843968 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843970 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843973 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843976 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843979 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843981 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843985 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843987 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843990 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843992 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 22:56:54.852019 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843995 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.843998 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844001 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844004 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844006 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844010 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844012 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844028 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844033 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844037 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844040 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844043 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844045 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844048 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844051 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844054 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844057 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844059 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844062 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844065 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 22:56:54.852762 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844068 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844070 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844073 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844075 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844078 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844080 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844083 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844085 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844088 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844090 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844093 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844096 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844099 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844102 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844104 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844107 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844110 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844113 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844115 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 22:56:54.853514 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844118 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844120 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844123 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844125 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844128 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844130 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844133 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844136 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844139 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844141 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844144 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844146 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844149 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844151 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844154 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844157 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844159 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844162 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844164 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844167 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 22:56:54.854252 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844169 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844172 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844174 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844177 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844180 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844183 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844185 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844189 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844193 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844196 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844199 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844202 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844204 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844207 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 22:56:54.854969 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844210 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.844230 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844345 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844350 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844353 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844357 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844360 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844362 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844366 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844369 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844371 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844374 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844376 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844379 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844382 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 22:56:54.855528 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844384 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844387 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844389 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844392 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844395 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844398 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844400 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844403 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844405 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844408 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844411 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844414 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844416 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844419 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844421 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844424 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844427 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844430 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844432 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844435 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 22:56:54.856069 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844438 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844441 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844443 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844446 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844449 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844452 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844455 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844457 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844460 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844463 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844465 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844468 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844471 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844473 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844476 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844479 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844481 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844485 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844489 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 22:56:54.856895 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844492 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844495 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844498 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844501 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844504 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844506 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844509 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844512 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844515 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844518 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844520 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844523 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844526 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844529 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844532 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844535 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844538 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844541 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844544 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844563 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 22:56:54.857607 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844567 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844570 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844573 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844576 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844578 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844581 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844584 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844586 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844589 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844592 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844594 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844597 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844600 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844603 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844605 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844608 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844610 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844613 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844615 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 22:56:54.858347 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844618 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844620 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844624 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844628 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844631 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844634 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844637 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:54.844640 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.844645 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.844755 2575 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.847140 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.848192 2575 server.go:1019] "Starting client certificate rotation" Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.848250 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 22:56:54.859060 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.848296 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 22:56:54.859566 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.851113 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 22:56:54.859566 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.852265 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 22:56:54.862264 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.862249 2575 log.go:25] "Validated CRI v1 runtime API" Sep 07 22:56:54.867915 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.866865 2575 log.go:25] "Validated CRI v1 image API" Sep 07 22:56:54.869675 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.869656 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 22:56:54.876022 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.875985 2575 fs.go:135] Filesystem UUIDs: map[41912a15-c4e9-4bf9-a5ef-83a16ae9a5eb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a90af64d-c6eb-445f-a669-8a5da4ee7fb5:/dev/nvme0n1p3] Sep 07 22:56:54.876098 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.876021 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 22:56:54.878593 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.878577 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 22:56:54.881352 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.881241 2575 manager.go:216] Machine: {Timestamp:2026-09-07 22:56:54.879871129 +0000 UTC m=+0.380220773 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099258 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20caa31577e717e94d3fe39f38f7b8 SystemUUID:ec20caa3-1577-e717-e94d-3fe39f38f7b8 BootID:d8000855-a7c3-411f-aad9-6debb596e3b3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:b5:e7:0a:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:b5:e7:0a:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:c2:5a:05:63:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 22:56:54.881352 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.881350 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 22:56:54.881489 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.881437 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 22:56:54.883297 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.883269 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 22:56:54.883430 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.883299 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-182.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 22:56:54.884144 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.884134 2575 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 22:56:54.884193 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.884147 2575 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 22:56:54.884193 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.884154 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 22:56:54.884968 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.884957 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 22:56:54.886698 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.886688 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 22:56:54.891901 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.891890 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 07 22:56:54.892020 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.892010 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 22:56:54.892061 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.892039 2575 kubelet.go:486] "Attempting to sync node with API server" Sep 07 22:56:54.892061 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.892052 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 22:56:54.892137 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.892075 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 22:56:54.892137 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.892087 2575 kubelet.go:398] "Adding apiserver pod source" Sep 07 22:56:54.892137 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.892096 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 22:56:54.892454 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.892442 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 22:56:54.892503 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.892460 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 22:56:54.895188 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.895173 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6td7k" Sep 07 22:56:54.896254 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.896231 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 22:56:54.899108 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899093 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 22:56:54.899201 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899123 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 22:56:54.899325 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899315 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 22:56:54.899370 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899332 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 22:56:54.899370 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899338 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 22:56:54.899370 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899346 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 22:56:54.899370 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899354 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 22:56:54.899370 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899362 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 22:56:54.899942 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899933 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 22:56:54.899942 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899943 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 22:56:54.900003 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899950 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 22:56:54.900003 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899955 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 22:56:54.900003 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899975 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 22:56:54.900003 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.899984 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 22:56:54.900111 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.900012 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 22:56:54.900111 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.900017 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 22:56:54.902061 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.902039 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6td7k" Sep 07 22:56:54.904227 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.904199 2575 server.go:1268] "Started kubelet" Sep 07 22:56:54.904360 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.904283 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 22:56:54.904671 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.904627 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 22:56:54.904671 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.904671 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 22:56:54.904842 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.904734 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-182.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 22:56:54.904891 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:54.904864 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 22:56:54.904957 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:54.904938 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 22:56:54.905137 ip-10-0-136-182 systemd[1]: Started Kubernetes Kubelet. Sep 07 22:56:54.909873 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.909848 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 22:56:54.911099 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:54.911075 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 22:56:54.912809 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.912794 2575 server.go:310] "Adding debug handlers to kubelet server" Sep 07 22:56:54.914089 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.914069 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 22:56:54.914089 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.914080 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 22:56:54.914249 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:54.914187 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:54.914931 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.914910 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 22:56:54.915023 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.914913 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 22:56:54.915023 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.914956 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 22:56:54.915112 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915031 2575 reconstruct.go:97] "Volume reconstruction finished" Sep 07 22:56:54.915112 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915040 2575 reconciler.go:29] "Reconciler: start to sync state" Sep 07 22:56:54.915175 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915144 2575 factory.go:55] Registering systemd factory Sep 07 22:56:54.915175 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915161 2575 factory.go:223] Registration of the systemd container factory successfully Sep 07 22:56:54.915509 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915488 2575 factory.go:153] Registering CRI-O factory Sep 07 22:56:54.915509 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915508 2575 factory.go:223] Registration of the crio container factory successfully Sep 07 22:56:54.915623 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915561 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 22:56:54.915623 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915580 2575 factory.go:103] Registering Raw factory Sep 07 22:56:54.915623 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915594 2575 manager.go:1196] Started watching for new ooms in manager Sep 07 22:56:54.915897 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915881 2575 manager.go:349] Starting recovery of all containers Sep 07 22:56:54.915987 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.915963 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 22:56:54.918570 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:54.918553 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-182.ec2.internal\" not found" node="ip-10-0-136-182.ec2.internal" Sep 07 22:56:54.924542 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.924521 2575 manager.go:354] Recovery completed Sep 07 22:56:54.929235 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.929208 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 22:56:54.933064 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.932947 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory" Sep 07 22:56:54.933142 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.933085 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 22:56:54.933142 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.933102 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID" Sep 07 22:56:54.933777 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.933761 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 22:56:54.933777 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.933774 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 22:56:54.933894 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.933791 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 07 22:56:54.933894 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.933774 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 22:56:54.934655 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.934641 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory" Sep 07 22:56:54.934745 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.934669 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 22:56:54.934745 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.934684 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID" Sep 07 22:56:54.935965 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.935952 2575 policy_none.go:49] "None policy: Start" Sep 07 22:56:54.936006 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.935968 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 22:56:54.936006 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.935978 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 22:56:54.937922 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.937910 2575 policy_none.go:47] "Start" Sep 07 22:56:54.995341 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.987848 2575 manager.go:337] "Starting Device Plugin manager" Sep 07 22:56:54.995341 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:54.987889 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 22:56:54.995341 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.987901 2575 server.go:87] "Starting device plugin registration server" Sep 07 22:56:54.995341 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.988273 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 22:56:54.995341 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.988284 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 22:56:54.995341 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.988397 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 22:56:54.995341 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.988490 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 22:56:54.995341 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:54.988497 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 22:56:54.995341 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:54.989537 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 22:56:54.995341 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:54.989592 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:55.015020 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.014980 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 22:56:55.016249 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.016235 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 22:56:55.016308 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.016279 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 22:56:55.016308 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.016306 2575 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 22:56:55.016441 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:55.016422 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 22:56:55.018170 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.018150 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 22:56:55.089186 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.089062 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 22:56:55.090169 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.090146 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory" Sep 07 22:56:55.090297 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.090180 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 22:56:55.090297 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.090193 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID" Sep 07 22:56:55.090297 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.090232 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-182.ec2.internal" Sep 07 22:56:55.099364 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.099342 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-182.ec2.internal" Sep 07 22:56:55.099436 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:55.099368 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-182.ec2.internal\": node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:55.112488 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:55.112461 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:55.116640 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.116625 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal"] Sep 07 22:56:55.116693 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.116686 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 22:56:55.118138 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.118123 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory" Sep 07 22:56:55.118230 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.118152 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 22:56:55.118230 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.118166 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID" Sep 07 22:56:55.120551 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.120538 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 22:56:55.120704 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.120691 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" Sep 07 22:56:55.120739 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.120718 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 22:56:55.121322 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.121308 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory" Sep 07 22:56:55.121390 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.121319 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory" Sep 07 22:56:55.121390 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.121337 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 22:56:55.121390 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.121345 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 22:56:55.121390 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.121351 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID" Sep 07 22:56:55.121390 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.121355 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID" Sep 07 22:56:55.123611 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.123597 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" Sep 07 22:56:55.123679 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.123622 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 22:56:55.124433 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.124417 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory" Sep 07 22:56:55.124512 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.124445 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 22:56:55.124512 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.124455 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID" Sep 07 22:56:55.150908 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:55.150888 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-182.ec2.internal\" not found" node="ip-10-0-136-182.ec2.internal" Sep 07 22:56:55.155117 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:55.155101 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-182.ec2.internal\" not found" node="ip-10-0-136-182.ec2.internal" Sep 07 22:56:55.213386 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:55.213359 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:55.314185 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:55.314148 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:55.316399 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.316376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09419a130dc8e362bb50f73e6ff09ea9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"09419a130dc8e362bb50f73e6ff09ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" Sep 07 22:56:55.316458 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.316418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09419a130dc8e362bb50f73e6ff09ea9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"09419a130dc8e362bb50f73e6ff09ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" Sep 07 22:56:55.316458 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:55.316439 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90a54d7775c37a0a8fb3d83f660006a3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-182.ec2.internal\" (UID: \"90a54d7775c37a0a8fb3d83f660006a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.423301 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:56.423254 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:56.425464 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.425449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09419a130dc8e362bb50f73e6ff09ea9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"09419a130dc8e362bb50f73e6ff09ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.425528 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.425472 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09419a130dc8e362bb50f73e6ff09ea9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"09419a130dc8e362bb50f73e6ff09ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.425528 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.425489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90a54d7775c37a0a8fb3d83f660006a3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-182.ec2.internal\" (UID: \"90a54d7775c37a0a8fb3d83f660006a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.425595 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.425551 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09419a130dc8e362bb50f73e6ff09ea9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"09419a130dc8e362bb50f73e6ff09ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.425595 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.425560 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90a54d7775c37a0a8fb3d83f660006a3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-182.ec2.internal\" (UID: \"90a54d7775c37a0a8fb3d83f660006a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.425658 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.425561 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09419a130dc8e362bb50f73e6ff09ea9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"09419a130dc8e362bb50f73e6ff09ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.461620 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.461590 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.466303 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.466243 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.523566 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:56.523523 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:56.623932 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:56.623900 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:56.724348 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:56.724314 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:56.824759 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:56.824722 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found" Sep 07 22:56:56.855988 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.855955 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 22:56:56.856538 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.856120 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 22:56:56.856538 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.856134 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 22:56:56.903595 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.903565 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 22:56:56.918389 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.918351 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 22:51:55 +0000 UTC" deadline="2028-03-13 01:26:52.02483297 +0000 UTC" Sep 07 22:56:56.918389 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.918387 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13250h29m55.106450122s" Sep 07 22:56:56.922872 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.922851 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.922953 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.922860 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 22:56:56.930885 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.930865 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 22:56:56.932708 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.932682 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" Sep 07 22:56:56.934992 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.934976 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 22:56:56.941351 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.941337 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 22:56:56.952770 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.952750 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9dswd" Sep 07 22:56:56.959262 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.959243 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9dswd" Sep 07 22:56:56.987828 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:56.987744 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a54d7775c37a0a8fb3d83f660006a3.slice/crio-85a7c22ce29259c654f65f83007c469cd17677f3dfec0f010d1c6e91309c504f WatchSource:0}: Error finding container 85a7c22ce29259c654f65f83007c469cd17677f3dfec0f010d1c6e91309c504f: Status 404 returned error can't find the container with id 85a7c22ce29259c654f65f83007c469cd17677f3dfec0f010d1c6e91309c504f Sep 07 22:56:56.988260 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:56.988236 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09419a130dc8e362bb50f73e6ff09ea9.slice/crio-55d37dd329e7ec12eae7a983cfd623daa38f29ff06631d7e6a27990f6415620a WatchSource:0}: Error finding container 55d37dd329e7ec12eae7a983cfd623daa38f29ff06631d7e6a27990f6415620a: Status 404 returned error can't find the container with id 55d37dd329e7ec12eae7a983cfd623daa38f29ff06631d7e6a27990f6415620a Sep 07 22:56:56.992990 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:56.992973 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 22:56:57.027998 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.027952 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" event={"ID":"90a54d7775c37a0a8fb3d83f660006a3","Type":"ContainerStarted","Data":"85a7c22ce29259c654f65f83007c469cd17677f3dfec0f010d1c6e91309c504f"} Sep 07 22:56:57.028958 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.028937 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" event={"ID":"09419a130dc8e362bb50f73e6ff09ea9","Type":"ContainerStarted","Data":"55d37dd329e7ec12eae7a983cfd623daa38f29ff06631d7e6a27990f6415620a"} Sep 07 22:56:57.055862 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.055838 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 22:56:57.824498 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.824466 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 22:56:57.889168 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.889138 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 22:56:57.902097 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.902067 2575 apiserver.go:52] "Watching apiserver" Sep 07 22:56:57.911106 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.911070 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 22:56:57.912114 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.912088 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-7ljz4","openshift-dns/node-resolver-dznnd","openshift-image-registry/node-ca-jzfnw","openshift-multus/multus-6x26b","openshift-multus/multus-additional-cni-plugins-26njv","openshift-multus/network-metrics-daemon-drkv2","kube-system/global-pull-secret-syncer-sxc47","kube-system/konnectivity-agent-9brr9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal","openshift-network-diagnostics/network-check-target-4gstr","openshift-network-operator/iptables-alerter-45xxb","openshift-ovn-kubernetes/ovnkube-node-hvc7g","kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk"] Sep 07 22:56:57.914536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.914512 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.916599 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.916578 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:57.916832 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.916815 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qz25z\"" Sep 07 22:56:57.917032 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.917006 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 22:56:57.917104 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.917009 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 22:56:57.918662 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.918634 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 22:56:57.918988 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.918970 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 22:56:57.919053 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.918971 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8dgvm\"" Sep 07 22:56:57.919189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.919176 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:57.921256 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.920991 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.923490 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.923464 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 22:56:57.923575 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.923569 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 22:56:57.923719 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.923668 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nhz6p\"" Sep 07 22:56:57.923815 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.923711 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:57.923815 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.923792 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 22:56:57.925763 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.925747 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:56:57.925854 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:57.925815 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:56:57.928121 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.928092 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:57.928216 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:57.928165 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:56:57.929097 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.928782 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 22:56:57.929097 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.928870 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rdjxj\"" Sep 07 22:56:57.929097 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.928923 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5fbf5\"" Sep 07 22:56:57.929097 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.928923 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 22:56:57.929097 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.928972 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 22:56:57.929097 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.929040 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 22:56:57.929437 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.929109 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 22:56:57.929437 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.929296 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 22:56:57.930672 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930326 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:56:57.930672 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-run-netns\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.930672 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-var-lib-kubelet\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.930672 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a517455b-ea8b-4c95-bf94-1c4b037603e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:57.930672 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a517455b-ea8b-4c95-bf94-1c4b037603e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:57.930672 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a517455b-ea8b-4c95-bf94-1c4b037603e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:57.930672 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-sysctl-conf\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.930672 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-sys\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.930672 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd75c66f-215a-4eb3-b9aa-ae24f452593b-hosts-file\") pod \"node-resolver-dznnd\" (UID: \"cd75c66f-215a-4eb3-b9aa-ae24f452593b\") " pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930743 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ca63b76-d100-4440-a8fb-0542e88abae0-cni-binary-copy\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930774 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-conf-dir\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930813 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-etc-kubernetes\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930843 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk9h7\" (UniqueName: \"kubernetes.io/projected/a517455b-ea8b-4c95-bf94-1c4b037603e5-kube-api-access-fk9h7\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930869 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-sysctl-d\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-var-lib-kubelet\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-socket-dir-parent\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.930969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-var-lib-cni-multus\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-run\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931042 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrjzs\" (UniqueName: \"kubernetes.io/projected/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-kube-api-access-wrjzs\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.931143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931103 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-run-multus-certs\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-modprobe-d\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-lib-modules\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-tuned\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-tmp\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-system-cni-dir\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-cni-dir\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a517455b-ea8b-4c95-bf94-1c4b037603e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931374 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zshrp\" (UniqueName: \"kubernetes.io/projected/6ca63b76-d100-4440-a8fb-0542e88abae0-kube-api-access-zshrp\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a517455b-ea8b-4c95-bf94-1c4b037603e5-system-cni-dir\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931441 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da3011ac-9e6b-4594-9704-ae1167d64bea-host\") pod \"node-ca-jzfnw\" (UID: \"da3011ac-9e6b-4594-9704-ae1167d64bea\") " pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931466 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqn7k\" (UniqueName: \"kubernetes.io/projected/da3011ac-9e6b-4594-9704-ae1167d64bea-kube-api-access-cqn7k\") pod \"node-ca-jzfnw\" (UID: \"da3011ac-9e6b-4594-9704-ae1167d64bea\") " pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-var-lib-cni-bin\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-hostroot\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-systemd\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd75c66f-215a-4eb3-b9aa-ae24f452593b-tmp-dir\") pod \"node-resolver-dznnd\" (UID: \"cd75c66f-215a-4eb3-b9aa-ae24f452593b\") " pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bkhj\" (UniqueName: \"kubernetes.io/projected/cd75c66f-215a-4eb3-b9aa-ae24f452593b-kube-api-access-6bkhj\") pod \"node-resolver-dznnd\" (UID: \"cd75c66f-215a-4eb3-b9aa-ae24f452593b\") " pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:57.931660 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da3011ac-9e6b-4594-9704-ae1167d64bea-serviceca\") pod \"node-ca-jzfnw\" (UID: \"da3011ac-9e6b-4594-9704-ae1167d64bea\") " pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:57.932459 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-daemon-config\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.932459 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a517455b-ea8b-4c95-bf94-1c4b037603e5-cnibin\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:57.932459 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931752 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-kubernetes\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.932459 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-host\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.932459 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-cnibin\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.932459 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931843 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-run-k8s-cni-cncf-io\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:57.932459 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:56:57.932459 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlqdl\" (UniqueName: \"kubernetes.io/projected/25fa86da-a99d-4924-9a7a-7cb993ac385c-kube-api-access-dlqdl\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:56:57.932459 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.931955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-sysconfig\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:57.932925 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.932654 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:56:57.932925 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:57.932730 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:56:57.932925 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.932787 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vzl7n\"" Sep 07 22:56:57.932925 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.932799 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 22:56:57.933142 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.933124 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 22:56:57.935034 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.935016 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:57.936950 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.936932 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 22:56:57.937383 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.937274 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xkzcb\"" Sep 07 22:56:57.937383 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.937295 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 22:56:57.937500 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.937419 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 22:56:57.937915 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.937897 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:57.939933 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.939911 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 22:56:57.940027 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.939923 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 22:56:57.940105 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.940085 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rrwxn\"" Sep 07 22:56:57.940204 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.940149 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 22:56:57.940619 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.940599 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:57.941070 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.941053 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 22:56:57.941127 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.941105 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 22:56:57.942080 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.941835 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 22:56:57.944723 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.943150 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 22:56:57.944723 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.943155 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-87s9d\"" Sep 07 22:56:57.944723 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.943431 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 22:56:57.944723 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.943564 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 22:56:57.963121 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.963075 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 22:51:56 +0000 UTC" deadline="2028-05-14 07:50:29.160213456 +0000 UTC" Sep 07 22:56:57.963121 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:57.963122 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14744h53m31.197095557s" Sep 07 22:56:58.025325 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.025297 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 22:56:58.032121 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032097 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-var-lib-kubelet\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.032275 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-run-netns\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.032275 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032154 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.032275 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-socket-dir-parent\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.032275 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032197 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrjzs\" (UniqueName: \"kubernetes.io/projected/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-kube-api-access-wrjzs\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.032275 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-var-lib-openvswitch\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.032275 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032268 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-socket-dir-parent\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-registration-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-lib-modules\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032351 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-system-cni-dir\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a517455b-ea8b-4c95-bf94-1c4b037603e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032394 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-run-ovn\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032239 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-var-lib-kubelet\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-log-socket\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032461 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-tuned\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032473 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-lib-modules\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15cc854b-4d68-43a7-8e8a-67e9c54899ea-agent-certs\") pod \"konnectivity-agent-9brr9\" (UID: \"15cc854b-4d68-43a7-8e8a-67e9c54899ea\") " pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032510 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-system-cni-dir\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032519 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a517455b-ea8b-4c95-bf94-1c4b037603e5-system-cni-dir\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.032565 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da3011ac-9e6b-4594-9704-ae1167d64bea-host\") pod \"node-ca-jzfnw\" (UID: \"da3011ac-9e6b-4594-9704-ae1167d64bea\") " pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032592 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a517455b-ea8b-4c95-bf94-1c4b037603e5-system-cni-dir\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-var-lib-cni-bin\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032597 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a517455b-ea8b-4c95-bf94-1c4b037603e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-systemd\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032621 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-var-lib-cni-bin\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-etc-openvswitch\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da3011ac-9e6b-4594-9704-ae1167d64bea-host\") pod \"node-ca-jzfnw\" (UID: \"da3011ac-9e6b-4594-9704-ae1167d64bea\") " pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032665 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd75c66f-215a-4eb3-b9aa-ae24f452593b-tmp-dir\") pod \"node-resolver-dznnd\" (UID: \"cd75c66f-215a-4eb3-b9aa-ae24f452593b\") " pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032675 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-systemd\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15cc854b-4d68-43a7-8e8a-67e9c54899ea-konnectivity-ca\") pod \"konnectivity-agent-9brr9\" (UID: \"15cc854b-4d68-43a7-8e8a-67e9c54899ea\") " pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032743 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-socket-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032763 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-sys-fs\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032795 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032834 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a3c58869-07cd-4220-8186-31b4f2bc256c-ovnkube-config\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-run-netns\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-var-lib-kubelet\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.032890 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:56:58.033189 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a517455b-ea8b-4c95-bf94-1c4b037603e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032919 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032928 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a517455b-ea8b-4c95-bf94-1c4b037603e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-slash\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032954 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd75c66f-215a-4eb3-b9aa-ae24f452593b-tmp-dir\") pod \"node-resolver-dznnd\" (UID: \"cd75c66f-215a-4eb3-b9aa-ae24f452593b\") " pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032957 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-run-netns\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.032988 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-var-lib-kubelet\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.032991 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs podName:25fa86da-a99d-4924-9a7a-7cb993ac385c nodeName:}" failed. No retries permitted until 2026-09-07 22:56:58.532950233 +0000 UTC m=+3.024830472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs") pod "network-metrics-daemon-drkv2" (UID: "25fa86da-a99d-4924-9a7a-7cb993ac385c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033094 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3c58869-07cd-4220-8186-31b4f2bc256c-ovn-node-metrics-cert\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033112 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml7ql\" (UniqueName: \"kubernetes.io/projected/a3c58869-07cd-4220-8186-31b4f2bc256c-kube-api-access-ml7ql\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd75c66f-215a-4eb3-b9aa-ae24f452593b-hosts-file\") pod \"node-resolver-dznnd\" (UID: \"cd75c66f-215a-4eb3-b9aa-ae24f452593b\") " pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033143 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-conf-dir\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-etc-kubernetes\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033178 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a3c58869-07cd-4220-8186-31b4f2bc256c-env-overrides\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033208 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-var-lib-cni-multus\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-run\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-kubelet\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.033860 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-etc-kubernetes\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033292 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-systemd-units\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd75c66f-215a-4eb3-b9aa-ae24f452593b-hosts-file\") pod \"node-resolver-dznnd\" (UID: \"cd75c66f-215a-4eb3-b9aa-ae24f452593b\") " pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033319 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-run-openvswitch\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-var-lib-cni-multus\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-run-multus-certs\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033391 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-run\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-modprobe-d\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033242 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-conf-dir\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-run-systemd\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033441 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a3c58869-07cd-4220-8186-31b4f2bc256c-ovnkube-script-lib\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033472 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-run-multus-certs\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033470 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-cni-dir\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e425f64-f9af-4fdf-843f-56276b8636b2-dbus\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033517 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fd531ff-49ca-4999-ac32-5ae75b0c13bf-iptables-alerter-script\") pod \"iptables-alerter-45xxb\" (UID: \"5fd531ff-49ca-4999-ac32-5ae75b0c13bf\") " pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:58.034635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033556 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a517455b-ea8b-4c95-bf94-1c4b037603e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033564 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-modprobe-d\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fd531ff-49ca-4999-ac32-5ae75b0c13bf-host-slash\") pod \"iptables-alerter-45xxb\" (UID: \"5fd531ff-49ca-4999-ac32-5ae75b0c13bf\") " pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033565 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a517455b-ea8b-4c95-bf94-1c4b037603e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spx48\" (UniqueName: \"kubernetes.io/projected/5fd531ff-49ca-4999-ac32-5ae75b0c13bf-kube-api-access-spx48\") pod \"iptables-alerter-45xxb\" (UID: \"5fd531ff-49ca-4999-ac32-5ae75b0c13bf\") " pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-tmp\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033631 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-cni-dir\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zshrp\" (UniqueName: \"kubernetes.io/projected/6ca63b76-d100-4440-a8fb-0542e88abae0-kube-api-access-zshrp\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033675 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqn7k\" (UniqueName: \"kubernetes.io/projected/da3011ac-9e6b-4594-9704-ae1167d64bea-kube-api-access-cqn7k\") pod \"node-ca-jzfnw\" (UID: \"da3011ac-9e6b-4594-9704-ae1167d64bea\") " pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-hostroot\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-node-log\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bkhj\" (UniqueName: \"kubernetes.io/projected/cd75c66f-215a-4eb3-b9aa-ae24f452593b-kube-api-access-6bkhj\") pod \"node-resolver-dznnd\" (UID: \"cd75c66f-215a-4eb3-b9aa-ae24f452593b\") " pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033785 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da3011ac-9e6b-4594-9704-ae1167d64bea-serviceca\") pod \"node-ca-jzfnw\" (UID: \"da3011ac-9e6b-4594-9704-ae1167d64bea\") " pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033807 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-daemon-config\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a517455b-ea8b-4c95-bf94-1c4b037603e5-cnibin\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-kubernetes\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-host\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.035536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x7wp\" (UniqueName: \"kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp\") pod \"network-check-target-4gstr\" (UID: \"31974305-b5bf-4206-855b-9a084b70a681\") " pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-cnibin\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033963 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-run-k8s-cni-cncf-io\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlqdl\" (UniqueName: \"kubernetes.io/projected/25fa86da-a99d-4924-9a7a-7cb993ac385c-kube-api-access-dlqdl\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-sysconfig\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034064 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-cni-bin\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034112 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-etc-selinux\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd797\" (UniqueName: \"kubernetes.io/projected/203721ca-1298-44d8-8da0-c99ae673e992-kube-api-access-qd797\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a517455b-ea8b-4c95-bf94-1c4b037603e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-sysctl-conf\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034214 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-sys\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e425f64-f9af-4fdf-843f-56276b8636b2-kubelet-config\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-cni-netd\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-device-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034357 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ca63b76-d100-4440-a8fb-0542e88abae0-cni-binary-copy\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk9h7\" (UniqueName: \"kubernetes.io/projected/a517455b-ea8b-4c95-bf94-1c4b037603e5-kube-api-access-fk9h7\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.036366 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034400 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ca63b76-d100-4440-a8fb-0542e88abae0-multus-daemon-config\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-sysctl-d\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034484 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da3011ac-9e6b-4594-9704-ae1167d64bea-serviceca\") pod \"node-ca-jzfnw\" (UID: \"da3011ac-9e6b-4594-9704-ae1167d64bea\") " pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034510 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a517455b-ea8b-4c95-bf94-1c4b037603e5-cnibin\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034527 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-sysctl-d\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034555 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-sys\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-host\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034668 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-cnibin\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034733 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-host-run-k8s-cni-cncf-io\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.033865 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ca63b76-d100-4440-a8fb-0542e88abae0-hostroot\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034793 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-sysconfig\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-kubernetes\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.034948 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a517455b-ea8b-4c95-bf94-1c4b037603e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.035009 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-sysctl-conf\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.035651 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ca63b76-d100-4440-a8fb-0542e88abae0-cni-binary-copy\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.036994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-tmp\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.037152 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.037043 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-etc-tuned\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.044029 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.044002 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrjzs\" (UniqueName: \"kubernetes.io/projected/bf29d542-effd-45c6-bfba-19a5fb7c3e2c-kube-api-access-wrjzs\") pod \"tuned-7ljz4\" (UID: \"bf29d542-effd-45c6-bfba-19a5fb7c3e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.044144 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.044067 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zshrp\" (UniqueName: \"kubernetes.io/projected/6ca63b76-d100-4440-a8fb-0542e88abae0-kube-api-access-zshrp\") pod \"multus-6x26b\" (UID: \"6ca63b76-d100-4440-a8fb-0542e88abae0\") " pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.044590 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.044543 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bkhj\" (UniqueName: \"kubernetes.io/projected/cd75c66f-215a-4eb3-b9aa-ae24f452593b-kube-api-access-6bkhj\") pod \"node-resolver-dznnd\" (UID: \"cd75c66f-215a-4eb3-b9aa-ae24f452593b\") " pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:58.044799 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.044783 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqn7k\" (UniqueName: \"kubernetes.io/projected/da3011ac-9e6b-4594-9704-ae1167d64bea-kube-api-access-cqn7k\") pod \"node-ca-jzfnw\" (UID: \"da3011ac-9e6b-4594-9704-ae1167d64bea\") " pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:58.045745 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.045702 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlqdl\" (UniqueName: \"kubernetes.io/projected/25fa86da-a99d-4924-9a7a-7cb993ac385c-kube-api-access-dlqdl\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:56:58.046216 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.046196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk9h7\" (UniqueName: \"kubernetes.io/projected/a517455b-ea8b-4c95-bf94-1c4b037603e5-kube-api-access-fk9h7\") pod \"multus-additional-cni-plugins-26njv\" (UID: \"a517455b-ea8b-4c95-bf94-1c4b037603e5\") " pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.134855 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-node-log\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.134855 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134839 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x7wp\" (UniqueName: \"kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp\") pod \"network-check-target-4gstr\" (UID: \"31974305-b5bf-4206-855b-9a084b70a681\") " pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:56:58.134855 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134857 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-cni-bin\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134873 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-etc-selinux\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134903 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd797\" (UniqueName: \"kubernetes.io/projected/203721ca-1298-44d8-8da0-c99ae673e992-kube-api-access-qd797\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134896 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-node-log\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134950 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-cni-bin\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134976 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-etc-selinux\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.134976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e425f64-f9af-4fdf-843f-56276b8636b2-kubelet-config\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135011 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e425f64-f9af-4fdf-843f-56276b8636b2-kubelet-config\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135015 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-cni-netd\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135044 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-cni-netd\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135048 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-device-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-run-netns\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135092 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-device-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135111 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135119 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-run-netns\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135138 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-var-lib-openvswitch\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135150 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135162 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-registration-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-var-lib-openvswitch\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135191 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-run-ovn\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-log-socket\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135231 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-registration-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15cc854b-4d68-43a7-8e8a-67e9c54899ea-agent-certs\") pod \"konnectivity-agent-9brr9\" (UID: \"15cc854b-4d68-43a7-8e8a-67e9c54899ea\") " pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135261 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-run-ovn\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-etc-openvswitch\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15cc854b-4d68-43a7-8e8a-67e9c54899ea-konnectivity-ca\") pod \"konnectivity-agent-9brr9\" (UID: \"15cc854b-4d68-43a7-8e8a-67e9c54899ea\") " pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135311 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-etc-openvswitch\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135265 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-log-socket\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-socket-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-sys-fs\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135383 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a3c58869-07cd-4220-8186-31b4f2bc256c-ovnkube-config\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.135909 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135401 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-slash\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.136504 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135409 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-socket-dir\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.136504 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135422 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3c58869-07cd-4220-8186-31b4f2bc256c-ovn-node-metrics-cert\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.136504 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135900 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-slash\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.136504 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.135768 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/203721ca-1298-44d8-8da0-c99ae673e992-sys-fs\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.136504 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136494 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a3c58869-07cd-4220-8186-31b4f2bc256c-ovnkube-config\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.136759 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136509 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15cc854b-4d68-43a7-8e8a-67e9c54899ea-konnectivity-ca\") pod \"konnectivity-agent-9brr9\" (UID: \"15cc854b-4d68-43a7-8e8a-67e9c54899ea\") " pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:56:58.136759 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml7ql\" (UniqueName: \"kubernetes.io/projected/a3c58869-07cd-4220-8186-31b4f2bc256c-kube-api-access-ml7ql\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.136759 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a3c58869-07cd-4220-8186-31b4f2bc256c-env-overrides\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.136759 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-kubelet\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.136759 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-systemd-units\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.136759 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-run-openvswitch\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.136759 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136738 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.137087 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-run-systemd\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.137087 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a3c58869-07cd-4220-8186-31b4f2bc256c-ovnkube-script-lib\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.137087 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e425f64-f9af-4fdf-843f-56276b8636b2-dbus\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:58.137087 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136851 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:58.137087 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fd531ff-49ca-4999-ac32-5ae75b0c13bf-iptables-alerter-script\") pod \"iptables-alerter-45xxb\" (UID: \"5fd531ff-49ca-4999-ac32-5ae75b0c13bf\") " pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:58.137087 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136932 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fd531ff-49ca-4999-ac32-5ae75b0c13bf-host-slash\") pod \"iptables-alerter-45xxb\" (UID: \"5fd531ff-49ca-4999-ac32-5ae75b0c13bf\") " pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:58.137087 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.136961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spx48\" (UniqueName: \"kubernetes.io/projected/5fd531ff-49ca-4999-ac32-5ae75b0c13bf-kube-api-access-spx48\") pod \"iptables-alerter-45xxb\" (UID: \"5fd531ff-49ca-4999-ac32-5ae75b0c13bf\") " pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:58.137426 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.137281 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-kubelet\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.137426 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.137345 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-systemd-units\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.137426 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.137391 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-run-openvswitch\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.137573 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.137436 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.137573 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.137479 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a3c58869-07cd-4220-8186-31b4f2bc256c-run-systemd\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.138219 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.137836 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 22:56:58.138219 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.137910 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret podName:2e425f64-f9af-4fdf-843f-56276b8636b2 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:58.637890997 +0000 UTC m=+3.129771237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret") pod "global-pull-secret-syncer-sxc47" (UID: "2e425f64-f9af-4fdf-843f-56276b8636b2") : object "kube-system"/"original-pull-secret" not registered Sep 07 22:56:58.138219 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.138066 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a3c58869-07cd-4220-8186-31b4f2bc256c-ovnkube-script-lib\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.138219 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.138088 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fd531ff-49ca-4999-ac32-5ae75b0c13bf-host-slash\") pod \"iptables-alerter-45xxb\" (UID: \"5fd531ff-49ca-4999-ac32-5ae75b0c13bf\") " pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:58.138219 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.138151 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e425f64-f9af-4fdf-843f-56276b8636b2-dbus\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:58.138576 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.138518 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fd531ff-49ca-4999-ac32-5ae75b0c13bf-iptables-alerter-script\") pod \"iptables-alerter-45xxb\" (UID: \"5fd531ff-49ca-4999-ac32-5ae75b0c13bf\") " pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:58.138576 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.138555 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15cc854b-4d68-43a7-8e8a-67e9c54899ea-agent-certs\") pod \"konnectivity-agent-9brr9\" (UID: \"15cc854b-4d68-43a7-8e8a-67e9c54899ea\") " pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:56:58.140061 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.138822 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a3c58869-07cd-4220-8186-31b4f2bc256c-env-overrides\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.140635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.140616 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3c58869-07cd-4220-8186-31b4f2bc256c-ovn-node-metrics-cert\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.142747 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.142725 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 22:56:58.142747 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.142751 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 22:56:58.142898 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.142764 2575 projected.go:196] Error preparing data for projected volume kube-api-access-8x7wp for pod openshift-network-diagnostics/network-check-target-4gstr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:56:58.142898 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.142820 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp podName:31974305-b5bf-4206-855b-9a084b70a681 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:58.642805872 +0000 UTC m=+3.134686097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8x7wp" (UniqueName: "kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp") pod "network-check-target-4gstr" (UID: "31974305-b5bf-4206-855b-9a084b70a681") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:56:58.144915 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.144881 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spx48\" (UniqueName: \"kubernetes.io/projected/5fd531ff-49ca-4999-ac32-5ae75b0c13bf-kube-api-access-spx48\") pod \"iptables-alerter-45xxb\" (UID: \"5fd531ff-49ca-4999-ac32-5ae75b0c13bf\") " pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:58.145160 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.145135 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml7ql\" (UniqueName: \"kubernetes.io/projected/a3c58869-07cd-4220-8186-31b4f2bc256c-kube-api-access-ml7ql\") pod \"ovnkube-node-hvc7g\" (UID: \"a3c58869-07cd-4220-8186-31b4f2bc256c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.145232 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.145165 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd797\" (UniqueName: \"kubernetes.io/projected/203721ca-1298-44d8-8da0-c99ae673e992-kube-api-access-qd797\") pod \"aws-ebs-csi-driver-node-7mpmk\" (UID: \"203721ca-1298-44d8-8da0-c99ae673e992\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.226007 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.225969 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" Sep 07 22:56:58.234800 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.234773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dznnd" Sep 07 22:56:58.243591 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.243567 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jzfnw" Sep 07 22:56:58.251358 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.251337 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6x26b" Sep 07 22:56:58.258188 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.258169 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-26njv" Sep 07 22:56:58.263837 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.263818 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:56:58.271546 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.271525 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-45xxb" Sep 07 22:56:58.277260 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.277241 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:56:58.282973 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.282952 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" Sep 07 22:56:58.540097 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.540057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:56:58.540302 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.540223 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:56:58.540370 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.540302 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs podName:25fa86da-a99d-4924-9a7a-7cb993ac385c nodeName:}" failed. No retries permitted until 2026-09-07 22:56:59.540280059 +0000 UTC m=+4.032160284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs") pod "network-metrics-daemon-drkv2" (UID: "25fa86da-a99d-4924-9a7a-7cb993ac385c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:56:58.640478 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.640440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:58.640654 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.640595 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 22:56:58.640721 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.640666 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret podName:2e425f64-f9af-4fdf-843f-56276b8636b2 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:59.64065215 +0000 UTC m=+4.132532381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret") pod "global-pull-secret-syncer-sxc47" (UID: "2e425f64-f9af-4fdf-843f-56276b8636b2") : object "kube-system"/"original-pull-secret" not registered Sep 07 22:56:58.741870 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.741822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x7wp\" (UniqueName: \"kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp\") pod \"network-check-target-4gstr\" (UID: \"31974305-b5bf-4206-855b-9a084b70a681\") " pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:56:58.742057 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.742011 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 22:56:58.742057 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.742044 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 22:56:58.742057 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.742058 2575 projected.go:196] Error preparing data for projected volume kube-api-access-8x7wp for pod openshift-network-diagnostics/network-check-target-4gstr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:56:58.742203 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:58.742123 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp podName:31974305-b5bf-4206-855b-9a084b70a681 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:59.74210492 +0000 UTC m=+4.233985167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x7wp" (UniqueName: "kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp") pod "network-check-target-4gstr" (UID: "31974305-b5bf-4206-855b-9a084b70a681") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:56:58.840605 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:58.840580 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15cc854b_4d68_43a7_8e8a_67e9c54899ea.slice/crio-087617bfff74297ed98fdaa9953a93b2fa55c239804a01018fc8a3b1985979b3 WatchSource:0}: Error finding container 087617bfff74297ed98fdaa9953a93b2fa55c239804a01018fc8a3b1985979b3: Status 404 returned error can't find the container with id 087617bfff74297ed98fdaa9953a93b2fa55c239804a01018fc8a3b1985979b3 Sep 07 22:56:58.841221 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:58.841188 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ca63b76_d100_4440_a8fb_0542e88abae0.slice/crio-5a87655c6e257907557b6d1ed2695008dfe4e87055d5ee3feff8db94cd9994c6 WatchSource:0}: Error finding container 5a87655c6e257907557b6d1ed2695008dfe4e87055d5ee3feff8db94cd9994c6: Status 404 returned error can't find the container with id 5a87655c6e257907557b6d1ed2695008dfe4e87055d5ee3feff8db94cd9994c6 Sep 07 22:56:58.842650 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:58.842604 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c58869_07cd_4220_8186_31b4f2bc256c.slice/crio-ca293616c9a9ea2360e2eae2083e24ff435031b41a14859a4fe705eadf178708 WatchSource:0}: Error finding container ca293616c9a9ea2360e2eae2083e24ff435031b41a14859a4fe705eadf178708: Status 404 returned error can't find the container with id ca293616c9a9ea2360e2eae2083e24ff435031b41a14859a4fe705eadf178708 Sep 07 22:56:58.843434 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:58.843392 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda517455b_ea8b_4c95_bf94_1c4b037603e5.slice/crio-b0a57e091853e2afdd9b0fdc5704eb8878e239e21af6246e83ec1def5c69fb2a WatchSource:0}: Error finding container b0a57e091853e2afdd9b0fdc5704eb8878e239e21af6246e83ec1def5c69fb2a: Status 404 returned error can't find the container with id b0a57e091853e2afdd9b0fdc5704eb8878e239e21af6246e83ec1def5c69fb2a Sep 07 22:56:58.847419 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:58.847396 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd531ff_49ca_4999_ac32_5ae75b0c13bf.slice/crio-57f24cdae84c0576598156f3e212654969962e2291d866f422ad6813db619a20 WatchSource:0}: Error finding container 57f24cdae84c0576598156f3e212654969962e2291d866f422ad6813db619a20: Status 404 returned error can't find the container with id 57f24cdae84c0576598156f3e212654969962e2291d866f422ad6813db619a20 Sep 07 22:56:58.848823 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:58.848802 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod203721ca_1298_44d8_8da0_c99ae673e992.slice/crio-f2336cd45241deaadaf4de016be23f80a18fe8198fb1c6b339a3598cad20613a WatchSource:0}: Error finding container f2336cd45241deaadaf4de016be23f80a18fe8198fb1c6b339a3598cad20613a: Status 404 returned error can't find the container with id f2336cd45241deaadaf4de016be23f80a18fe8198fb1c6b339a3598cad20613a Sep 07 22:56:58.849323 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:58.849235 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf29d542_effd_45c6_bfba_19a5fb7c3e2c.slice/crio-f61228dffb526189d3e170d7a933aa0378e56fcfe2d389aba8bb0aae1304ac1f WatchSource:0}: Error finding container f61228dffb526189d3e170d7a933aa0378e56fcfe2d389aba8bb0aae1304ac1f: Status 404 returned error can't find the container with id f61228dffb526189d3e170d7a933aa0378e56fcfe2d389aba8bb0aae1304ac1f Sep 07 22:56:58.850782 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:58.850759 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd75c66f_215a_4eb3_b9aa_ae24f452593b.slice/crio-cb90b98ea048f2075cf9c99d3d53d3f9827466879be38ef436c1e4a143c7b973 WatchSource:0}: Error finding container cb90b98ea048f2075cf9c99d3d53d3f9827466879be38ef436c1e4a143c7b973: Status 404 returned error can't find the container with id cb90b98ea048f2075cf9c99d3d53d3f9827466879be38ef436c1e4a143c7b973 Sep 07 22:56:58.851871 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:56:58.851785 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3011ac_9e6b_4594_9704_ae1167d64bea.slice/crio-e9fd59c27028257e7a16f3763c2b5a72cd410466c360c97bea61676482d405a9 WatchSource:0}: Error finding container e9fd59c27028257e7a16f3763c2b5a72cd410466c360c97bea61676482d405a9: Status 404 returned error can't find the container with id e9fd59c27028257e7a16f3763c2b5a72cd410466c360c97bea61676482d405a9 Sep 07 22:56:58.963862 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.963638 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 22:51:56 +0000 UTC" deadline="2028-05-08 16:09:09.193451718 +0000 UTC" Sep 07 22:56:58.963862 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:58.963857 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14609h12m10.229598935s" Sep 07 22:56:59.033006 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.032974 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jzfnw" event={"ID":"da3011ac-9e6b-4594-9704-ae1167d64bea","Type":"ContainerStarted","Data":"e9fd59c27028257e7a16f3763c2b5a72cd410466c360c97bea61676482d405a9"} Sep 07 22:56:59.034100 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.034072 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" event={"ID":"203721ca-1298-44d8-8da0-c99ae673e992","Type":"ContainerStarted","Data":"f2336cd45241deaadaf4de016be23f80a18fe8198fb1c6b339a3598cad20613a"} Sep 07 22:56:59.035278 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.035250 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-26njv" event={"ID":"a517455b-ea8b-4c95-bf94-1c4b037603e5","Type":"ContainerStarted","Data":"b0a57e091853e2afdd9b0fdc5704eb8878e239e21af6246e83ec1def5c69fb2a"} Sep 07 22:56:59.036382 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.036353 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6x26b" event={"ID":"6ca63b76-d100-4440-a8fb-0542e88abae0","Type":"ContainerStarted","Data":"5a87655c6e257907557b6d1ed2695008dfe4e87055d5ee3feff8db94cd9994c6"} Sep 07 22:56:59.037643 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.037620 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" event={"ID":"a3c58869-07cd-4220-8186-31b4f2bc256c","Type":"ContainerStarted","Data":"ca293616c9a9ea2360e2eae2083e24ff435031b41a14859a4fe705eadf178708"} Sep 07 22:56:59.038985 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.038962 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9brr9" event={"ID":"15cc854b-4d68-43a7-8e8a-67e9c54899ea","Type":"ContainerStarted","Data":"087617bfff74297ed98fdaa9953a93b2fa55c239804a01018fc8a3b1985979b3"} Sep 07 22:56:59.041224 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.041197 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dznnd" event={"ID":"cd75c66f-215a-4eb3-b9aa-ae24f452593b","Type":"ContainerStarted","Data":"cb90b98ea048f2075cf9c99d3d53d3f9827466879be38ef436c1e4a143c7b973"} Sep 07 22:56:59.043580 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.043555 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" event={"ID":"bf29d542-effd-45c6-bfba-19a5fb7c3e2c","Type":"ContainerStarted","Data":"f61228dffb526189d3e170d7a933aa0378e56fcfe2d389aba8bb0aae1304ac1f"} Sep 07 22:56:59.044729 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.044701 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-45xxb" event={"ID":"5fd531ff-49ca-4999-ac32-5ae75b0c13bf","Type":"ContainerStarted","Data":"57f24cdae84c0576598156f3e212654969962e2291d866f422ad6813db619a20"} Sep 07 22:56:59.049314 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.049283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" event={"ID":"90a54d7775c37a0a8fb3d83f660006a3","Type":"ContainerStarted","Data":"cda1f5674625f3076fbe3f31264cc2ab23e1c91bc15b9cb5d9056774d7b28e7d"} Sep 07 22:56:59.061437 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.061383 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" podStartSLOduration=3.061360475 podStartE2EDuration="3.061360475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:56:59.061345563 +0000 UTC m=+3.553225811" watchObservedRunningTime="2026-09-07 22:56:59.061360475 +0000 UTC m=+3.553240719" Sep 07 22:56:59.548276 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.548232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:56:59.548471 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:59.548449 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:56:59.548541 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:59.548514 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs podName:25fa86da-a99d-4924-9a7a-7cb993ac385c nodeName:}" failed. No retries permitted until 2026-09-07 22:57:01.548495361 +0000 UTC m=+6.040375608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs") pod "network-metrics-daemon-drkv2" (UID: "25fa86da-a99d-4924-9a7a-7cb993ac385c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:56:59.649635 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.649574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:56:59.649941 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:59.649799 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 22:56:59.649941 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:59.649864 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret podName:2e425f64-f9af-4fdf-843f-56276b8636b2 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:01.64984612 +0000 UTC m=+6.141726369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret") pod "global-pull-secret-syncer-sxc47" (UID: "2e425f64-f9af-4fdf-843f-56276b8636b2") : object "kube-system"/"original-pull-secret" not registered Sep 07 22:56:59.750745 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:56:59.750701 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x7wp\" (UniqueName: \"kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp\") pod \"network-check-target-4gstr\" (UID: \"31974305-b5bf-4206-855b-9a084b70a681\") " pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:56:59.750936 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:59.750918 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 22:56:59.751006 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:59.750941 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 22:56:59.751006 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:59.750954 2575 projected.go:196] Error preparing data for projected volume kube-api-access-8x7wp for pod openshift-network-diagnostics/network-check-target-4gstr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:56:59.751111 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:56:59.751014 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp podName:31974305-b5bf-4206-855b-9a084b70a681 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:01.75099474 +0000 UTC m=+6.242874982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x7wp" (UniqueName: "kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp") pod "network-check-target-4gstr" (UID: "31974305-b5bf-4206-855b-9a084b70a681") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:57:00.026859 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:00.026821 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:00.027461 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:00.026963 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:00.027461 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:00.027375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:00.027573 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:00.027469 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:00.027573 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:00.027544 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:00.027681 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:00.027609 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:00.070249 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:00.070206 2575 generic.go:356] "Generic (PLEG): container finished" podID="09419a130dc8e362bb50f73e6ff09ea9" containerID="a6457f5b4aca7427bed3f17d11e3686eb373e346662990b2a8c2a8d713991bb2" exitCode=0 Sep 07 22:57:00.070426 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:00.070409 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" event={"ID":"09419a130dc8e362bb50f73e6ff09ea9","Type":"ContainerDied","Data":"a6457f5b4aca7427bed3f17d11e3686eb373e346662990b2a8c2a8d713991bb2"} Sep 07 22:57:01.100658 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:01.100613 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" event={"ID":"09419a130dc8e362bb50f73e6ff09ea9","Type":"ContainerStarted","Data":"e2d95968f967671b0870f7e97fbc62e08723915ce062b23b81260c80bfdb741f"} Sep 07 22:57:01.565805 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:01.565762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:01.565984 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:01.565955 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:57:01.566062 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:01.566002 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs podName:25fa86da-a99d-4924-9a7a-7cb993ac385c nodeName:}" failed. No retries permitted until 2026-09-07 22:57:05.565990623 +0000 UTC m=+10.057870848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs") pod "network-metrics-daemon-drkv2" (UID: "25fa86da-a99d-4924-9a7a-7cb993ac385c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:57:01.667068 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:01.666505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:01.667068 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:01.666657 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 22:57:01.667068 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:01.666731 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret podName:2e425f64-f9af-4fdf-843f-56276b8636b2 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:05.666713646 +0000 UTC m=+10.158593880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret") pod "global-pull-secret-syncer-sxc47" (UID: "2e425f64-f9af-4fdf-843f-56276b8636b2") : object "kube-system"/"original-pull-secret" not registered Sep 07 22:57:01.768121 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:01.767808 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x7wp\" (UniqueName: \"kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp\") pod \"network-check-target-4gstr\" (UID: \"31974305-b5bf-4206-855b-9a084b70a681\") " pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:01.768121 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:01.768025 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 22:57:01.768121 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:01.768047 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 22:57:01.768121 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:01.768062 2575 projected.go:196] Error preparing data for projected volume kube-api-access-8x7wp for pod openshift-network-diagnostics/network-check-target-4gstr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:57:01.768121 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:01.768120 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp podName:31974305-b5bf-4206-855b-9a084b70a681 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:05.768103349 +0000 UTC m=+10.259983577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x7wp" (UniqueName: "kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp") pod "network-check-target-4gstr" (UID: "31974305-b5bf-4206-855b-9a084b70a681") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:57:02.026027 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:02.025284 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:02.026027 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:02.025412 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:02.026027 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:02.025790 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:02.026027 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:02.025862 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:02.026027 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:02.025916 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:02.026027 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:02.025972 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:04.025928 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:04.025888 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:04.026437 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:04.025938 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:04.026437 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:04.025891 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:04.026437 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:04.026039 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:04.026437 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:04.026197 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:04.026437 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:04.026288 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:05.600977 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:05.600943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:05.601344 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:05.601046 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:57:05.601344 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:05.601096 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs podName:25fa86da-a99d-4924-9a7a-7cb993ac385c nodeName:}" failed. No retries permitted until 2026-09-07 22:57:13.601079009 +0000 UTC m=+18.092959234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs") pod "network-metrics-daemon-drkv2" (UID: "25fa86da-a99d-4924-9a7a-7cb993ac385c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:57:05.701808 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:05.701767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:05.701990 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:05.701937 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 22:57:05.702049 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:05.701997 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret podName:2e425f64-f9af-4fdf-843f-56276b8636b2 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:13.701980258 +0000 UTC m=+18.193860490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret") pod "global-pull-secret-syncer-sxc47" (UID: "2e425f64-f9af-4fdf-843f-56276b8636b2") : object "kube-system"/"original-pull-secret" not registered Sep 07 22:57:05.802350 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:05.802310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x7wp\" (UniqueName: \"kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp\") pod \"network-check-target-4gstr\" (UID: \"31974305-b5bf-4206-855b-9a084b70a681\") " pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:05.802545 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:05.802514 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 22:57:05.802545 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:05.802533 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 22:57:05.802545 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:05.802546 2575 projected.go:196] Error preparing data for projected volume kube-api-access-8x7wp for pod openshift-network-diagnostics/network-check-target-4gstr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:57:05.802758 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:05.802607 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp podName:31974305-b5bf-4206-855b-9a084b70a681 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:13.802589474 +0000 UTC m=+18.294469713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x7wp" (UniqueName: "kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp") pod "network-check-target-4gstr" (UID: "31974305-b5bf-4206-855b-9a084b70a681") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:57:06.027779 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:06.026995 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:06.027779 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:06.027103 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:06.027779 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:06.027502 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:06.027779 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:06.027592 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:06.027779 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:06.027650 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:06.027779 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:06.027741 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:08.027595 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:08.027570 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:08.027973 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:08.027571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:08.027973 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:08.027571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:08.027973 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:08.027698 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:08.027973 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:08.027756 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:08.027973 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:08.027821 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:10.025753 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:10.025710 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:10.026241 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:10.025710 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:10.026241 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:10.025842 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:10.026241 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:10.025848 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:10.026241 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:10.025951 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:10.026241 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:10.026044 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:12.025213 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:12.025172 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:12.025669 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:12.025181 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:12.025669 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:12.025293 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:12.025669 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:12.025382 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:12.025669 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:12.025189 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:12.025669 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:12.025502 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:13.660172 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:13.660136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:13.660617 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:13.660264 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:57:13.660617 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:13.660314 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs podName:25fa86da-a99d-4924-9a7a-7cb993ac385c nodeName:}" failed. No retries permitted until 2026-09-07 22:57:29.660299885 +0000 UTC m=+34.152180110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs") pod "network-metrics-daemon-drkv2" (UID: "25fa86da-a99d-4924-9a7a-7cb993ac385c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:57:13.760921 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:13.760716 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:13.761087 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:13.760870 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 22:57:13.761087 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:13.761060 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret podName:2e425f64-f9af-4fdf-843f-56276b8636b2 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:29.761038103 +0000 UTC m=+34.252918352 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret") pod "global-pull-secret-syncer-sxc47" (UID: "2e425f64-f9af-4fdf-843f-56276b8636b2") : object "kube-system"/"original-pull-secret" not registered Sep 07 22:57:13.862041 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:13.862010 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x7wp\" (UniqueName: \"kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp\") pod \"network-check-target-4gstr\" (UID: \"31974305-b5bf-4206-855b-9a084b70a681\") " pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:13.862220 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:13.862163 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 22:57:13.862220 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:13.862183 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 22:57:13.862220 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:13.862195 2575 projected.go:196] Error preparing data for projected volume kube-api-access-8x7wp for pod openshift-network-diagnostics/network-check-target-4gstr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:57:13.862377 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:13.862257 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp podName:31974305-b5bf-4206-855b-9a084b70a681 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:29.86223929 +0000 UTC m=+34.354119514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x7wp" (UniqueName: "kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp") pod "network-check-target-4gstr" (UID: "31974305-b5bf-4206-855b-9a084b70a681") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:57:14.025243 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:14.025157 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:14.025393 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:14.025157 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:14.025393 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:14.025288 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:14.025393 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:14.025309 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:14.025546 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:14.025391 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:14.025546 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:14.025480 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:16.026258 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:16.026228 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:16.026760 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:16.026346 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:16.026760 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:16.026433 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:16.026760 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:16.026534 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:16.026760 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:16.026586 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:16.026760 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:16.026715 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:17.133977 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.133623 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jzfnw" event={"ID":"da3011ac-9e6b-4594-9704-ae1167d64bea","Type":"ContainerStarted","Data":"bd8ef2a23a59fc0d116828d3b10215675d6aa29e9f48be2e118312dcea2223b7"} Sep 07 22:57:17.135811 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.135775 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" event={"ID":"203721ca-1298-44d8-8da0-c99ae673e992","Type":"ContainerStarted","Data":"12fb4278f9341905e54d8791ba5f14aa7d4a046660abe8798f7c64fda18d3f0f"} Sep 07 22:57:17.137835 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.137786 2575 generic.go:356] "Generic (PLEG): container finished" podID="a517455b-ea8b-4c95-bf94-1c4b037603e5" containerID="07c3f982947e8a5d2d643d703d42e1a4e2b164d079c15c01b70cfef64337e21c" exitCode=0 Sep 07 22:57:17.137962 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.137880 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-26njv" event={"ID":"a517455b-ea8b-4c95-bf94-1c4b037603e5","Type":"ContainerDied","Data":"07c3f982947e8a5d2d643d703d42e1a4e2b164d079c15c01b70cfef64337e21c"} Sep 07 22:57:17.139697 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.139664 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6x26b" event={"ID":"6ca63b76-d100-4440-a8fb-0542e88abae0","Type":"ContainerStarted","Data":"b6cdf2f4d435fb6bc4504614d825f24f8607d13dfff3df04083e840128837cfb"} Sep 07 22:57:17.143121 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.143101 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 22:57:17.143553 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.143530 2575 generic.go:356] "Generic (PLEG): container finished" podID="a3c58869-07cd-4220-8186-31b4f2bc256c" containerID="397745a1517ed51d0c114d31351df4aabd8c28e7d841e545279c1e41dc3f3659" exitCode=1 Sep 07 22:57:17.143645 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.143602 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" event={"ID":"a3c58869-07cd-4220-8186-31b4f2bc256c","Type":"ContainerStarted","Data":"17ea27246f608f6ba45713195117c3d5abe3a19564eb0976b698c9218dcaa2f8"} Sep 07 22:57:17.143785 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.143670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" event={"ID":"a3c58869-07cd-4220-8186-31b4f2bc256c","Type":"ContainerStarted","Data":"1f18b4023fea8544f321331ad82ee1c31824e32539e5fee818da41e087281928"} Sep 07 22:57:17.143785 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.143741 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" event={"ID":"a3c58869-07cd-4220-8186-31b4f2bc256c","Type":"ContainerStarted","Data":"31286a055c8ae6aa98d7e2870803f26bbadd770a58cd4802709d6fba242ee0f6"} Sep 07 22:57:17.143890 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.143792 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" event={"ID":"a3c58869-07cd-4220-8186-31b4f2bc256c","Type":"ContainerStarted","Data":"97dd79c1506094557c95303e6c90c2b2abe1ecce13cead065a6a9e849560976b"} Sep 07 22:57:17.143890 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.143839 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" event={"ID":"a3c58869-07cd-4220-8186-31b4f2bc256c","Type":"ContainerDied","Data":"397745a1517ed51d0c114d31351df4aabd8c28e7d841e545279c1e41dc3f3659"} Sep 07 22:57:17.143972 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.143890 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" event={"ID":"a3c58869-07cd-4220-8186-31b4f2bc256c","Type":"ContainerStarted","Data":"42bff82ba244de980e29f090a1501b0f8953134f43c4ef0e29a7dc17d308cc3d"} Sep 07 22:57:17.146143 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.145854 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9brr9" event={"ID":"15cc854b-4d68-43a7-8e8a-67e9c54899ea","Type":"ContainerStarted","Data":"d6a7f7f7a298bd59610ae662c1932349d54cf5377140c651b8f618fd60ad4f7c"} Sep 07 22:57:17.147536 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.147509 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dznnd" event={"ID":"cd75c66f-215a-4eb3-b9aa-ae24f452593b","Type":"ContainerStarted","Data":"3d4ed993bc65928fc3fe939498a41d82ec522266ece4fa5679316afa559a9f9b"} Sep 07 22:57:17.149607 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.149580 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" event={"ID":"bf29d542-effd-45c6-bfba-19a5fb7c3e2c","Type":"ContainerStarted","Data":"96f708c90d62122b7eb442bfae86e7eb6686d55d8a8bf27683d77338755fb5e9"} Sep 07 22:57:17.150223 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.150081 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jzfnw" podStartSLOduration=3.547653979 podStartE2EDuration="21.150066993s" totalImagesPullingTime="17.602413014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:17.149341531 +0000 UTC m=+21.641221779" watchObservedRunningTime="2026-09-07 22:57:17.150066993 +0000 UTC m=+21.641947238" Sep 07 22:57:17.150505 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.150469 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" podStartSLOduration=21.150461587 podStartE2EDuration="21.150461587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:01.11576716 +0000 UTC m=+5.607647408" watchObservedRunningTime="2026-09-07 22:57:17.150461587 +0000 UTC m=+21.642341850" Sep 07 22:57:17.161274 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.161227 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dznnd" podStartSLOduration=3.557796137 podStartE2EDuration="21.161213453s" totalImagesPullingTime="17.603417316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:17.160985475 +0000 UTC m=+21.652865732" watchObservedRunningTime="2026-09-07 22:57:17.161213453 +0000 UTC m=+21.653093700" Sep 07 22:57:17.175607 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.175555 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6x26b" podStartSLOduration=3.365728081 podStartE2EDuration="21.175539547s" totalImagesPullingTime="17.809811466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:17.174933846 +0000 UTC m=+21.666814094" watchObservedRunningTime="2026-09-07 22:57:17.175539547 +0000 UTC m=+21.667419795" Sep 07 22:57:17.188231 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.188163 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9brr9" podStartSLOduration=10.861552734 podStartE2EDuration="21.188144486s" totalImagesPullingTime="10.326591752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:17.187518237 +0000 UTC m=+21.679398509" watchObservedRunningTime="2026-09-07 22:57:17.188144486 +0000 UTC m=+21.680024736" Sep 07 22:57:17.222838 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.222776 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7ljz4" podStartSLOduration=3.616333945 podStartE2EDuration="21.222755346s" totalImagesPullingTime="17.606421401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:17.222235624 +0000 UTC m=+21.714115896" watchObservedRunningTime="2026-09-07 22:57:17.222755346 +0000 UTC m=+21.714635596" Sep 07 22:57:17.872890 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:17.872843 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 22:57:18.008809 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:18.008648 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T22:57:17.872865828Z","UUID":"d5f3777e-e5d6-4fb0-af26-274c0cf757d9","Handler":null,"Name":"","Endpoint":""} Sep 07 22:57:18.010369 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:18.010345 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 22:57:18.010369 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:18.010381 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 22:57:18.025595 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:18.025559 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:18.025759 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:18.025559 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:18.025759 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:18.025722 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:18.025895 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:18.025564 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:18.025895 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:18.025782 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:18.025895 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:18.025876 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:18.154612 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:18.154564 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" event={"ID":"203721ca-1298-44d8-8da0-c99ae673e992","Type":"ContainerStarted","Data":"5815efa9e95d7eb3c2a898a64ce5a38bfbbb2af2ec3637e3d7e6023afa26ed89"} Sep 07 22:57:18.156429 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:18.156385 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-45xxb" event={"ID":"5fd531ff-49ca-4999-ac32-5ae75b0c13bf","Type":"ContainerStarted","Data":"d4fb28b279f9fa343a6cbfbec0edbd081da0ae05017e479494a70f09cd0bb89a"} Sep 07 22:57:18.169481 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:18.169432 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-45xxb" podStartSLOduration=4.562589199 podStartE2EDuration="22.169414013s" totalImagesPullingTime="17.606824814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:18.169268716 +0000 UTC m=+22.661148964" watchObservedRunningTime="2026-09-07 22:57:18.169414013 +0000 UTC m=+22.661294264" Sep 07 22:57:19.161981 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:19.161764 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" event={"ID":"203721ca-1298-44d8-8da0-c99ae673e992","Type":"ContainerStarted","Data":"61c5b3de1b2663559c368fd9c3006117d12e6fcd1f04ccf4cb4cbb3ea6d1eef9"} Sep 07 22:57:19.176975 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:19.176925 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mpmk" podStartSLOduration=3.5413183249999998 podStartE2EDuration="23.176903836s" totalImagesPullingTime="19.635585511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:19.17647648 +0000 UTC m=+23.668356747" watchObservedRunningTime="2026-09-07 22:57:19.176903836 +0000 UTC m=+23.668784083" Sep 07 22:57:20.026055 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:20.026022 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:20.026253 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:20.026022 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:20.026253 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:20.026154 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:20.026253 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:20.026027 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:20.026253 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:20.026238 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:20.026420 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:20.026294 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:20.167899 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:20.167873 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 22:57:20.168407 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:20.168383 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" event={"ID":"a3c58869-07cd-4220-8186-31b4f2bc256c","Type":"ContainerStarted","Data":"bb1b96d06e97322da365c060e4a53ea04da75ece4e25c527c6c190fb71891fc1"} Sep 07 22:57:20.755303 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:20.755256 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:57:20.755951 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:20.755935 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:57:21.170483 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:21.170451 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:57:21.170986 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:21.170972 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9brr9" Sep 07 22:57:22.025870 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:22.025562 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:22.026138 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:22.025567 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:22.026138 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:22.025943 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:22.026138 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:22.025589 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:22.026138 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:22.026007 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:22.026138 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:22.026055 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:22.174757 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:22.174726 2575 generic.go:356] "Generic (PLEG): container finished" podID="a517455b-ea8b-4c95-bf94-1c4b037603e5" containerID="ed29c14fc94da367470fe326228780cee72e9dcb12c739fcaee5cfe99ed5422d" exitCode=0 Sep 07 22:57:22.175153 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:22.174807 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-26njv" event={"ID":"a517455b-ea8b-4c95-bf94-1c4b037603e5","Type":"ContainerDied","Data":"ed29c14fc94da367470fe326228780cee72e9dcb12c739fcaee5cfe99ed5422d"} Sep 07 22:57:22.178595 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:22.178488 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 22:57:22.178929 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:22.178895 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" event={"ID":"a3c58869-07cd-4220-8186-31b4f2bc256c","Type":"ContainerStarted","Data":"973055dcbaa422afad81dda2c7b801cb007b497d9b44c3ae2e571ab978c05e48"} Sep 07 22:57:22.179230 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:22.179203 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:57:22.179379 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:22.179360 2575 scope.go:117] "RemoveContainer" containerID="397745a1517ed51d0c114d31351df4aabd8c28e7d841e545279c1e41dc3f3659" Sep 07 22:57:22.195014 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:22.194995 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:57:23.185269 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.185243 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 22:57:23.185957 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.185834 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" event={"ID":"a3c58869-07cd-4220-8186-31b4f2bc256c","Type":"ContainerStarted","Data":"610aeb493253e6d2760e96ff33d1aded9071b71f2b00483203c386351c7c8bcf"} Sep 07 22:57:23.186221 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.186197 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:57:23.186311 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.186289 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:57:23.205041 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.205021 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:57:23.219530 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.219478 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" podStartSLOduration=9.590120362 podStartE2EDuration="27.219450819s" totalImagesPullingTime="17.629330457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:23.218605939 +0000 UTC m=+27.710486190" watchObservedRunningTime="2026-09-07 22:57:23.219450819 +0000 UTC m=+27.711331069" Sep 07 22:57:23.405675 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.405478 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4gstr"] Sep 07 22:57:23.405838 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.405775 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:23.405901 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:23.405877 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:23.408582 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.408545 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sxc47"] Sep 07 22:57:23.408716 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.408648 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:23.408791 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:23.408764 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:23.409334 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.409276 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-drkv2"] Sep 07 22:57:23.409410 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.409372 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:23.409492 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:23.409469 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:23.914671 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.914641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:23.996963 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:23.996925 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:24.097434 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:24.097396 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:24.147361 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:24.147331 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:24.189925 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:24.189851 2575 generic.go:356] "Generic (PLEG): container finished" podID="a517455b-ea8b-4c95-bf94-1c4b037603e5" containerID="b324b5b5857c5867e11f2824c156c9c250f75ec27aa8725769d9261045a2a025" exitCode=0 Sep 07 22:57:24.190352 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:24.189940 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-26njv" event={"ID":"a517455b-ea8b-4c95-bf94-1c4b037603e5","Type":"ContainerDied","Data":"b324b5b5857c5867e11f2824c156c9c250f75ec27aa8725769d9261045a2a025"} Sep 07 22:57:25.025153 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:25.025122 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:25.025292 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:25.025123 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:25.025292 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:25.025219 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:25.025292 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:25.025133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:25.025393 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:25.025277 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:25.025393 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:25.025380 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:26.200861 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:26.200817 2575 generic.go:356] "Generic (PLEG): container finished" podID="a517455b-ea8b-4c95-bf94-1c4b037603e5" containerID="5e971b8d042f8c965f440b960ea5494be69eb219464eb17067219b702431cf96" exitCode=0 Sep 07 22:57:26.201300 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:26.200892 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-26njv" event={"ID":"a517455b-ea8b-4c95-bf94-1c4b037603e5","Type":"ContainerDied","Data":"5e971b8d042f8c965f440b960ea5494be69eb219464eb17067219b702431cf96"} Sep 07 22:57:26.280151 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:26.280109 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:26.380475 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:26.380443 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:26.954392 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:26.954358 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:27.006401 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:27.006348 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:27.025462 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:27.025438 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:27.025633 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:27.025551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:27.025633 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:27.025556 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:27.025633 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:27.025563 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:27.025816 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:27.025674 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:27.025816 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:27.025783 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:29.025461 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:29.025422 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:29.026067 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:29.025471 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:29.026067 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:29.025515 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:29.026067 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.025546 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gstr" podUID="31974305-b5bf-4206-855b-9a084b70a681" Sep 07 22:57:29.026067 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.025675 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:57:29.026067 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.025762 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sxc47" podUID="2e425f64-f9af-4fdf-843f-56276b8636b2" Sep 07 22:57:29.617980 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:29.617878 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:29.666848 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:29.666807 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:29.669840 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:29.669814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:29.669996 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.669978 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:57:29.670062 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.670050 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs podName:25fa86da-a99d-4924-9a7a-7cb993ac385c nodeName:}" failed. No retries permitted until 2026-09-07 22:58:01.670031595 +0000 UTC m=+66.161911835 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs") pod "network-metrics-daemon-drkv2" (UID: "25fa86da-a99d-4924-9a7a-7cb993ac385c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 22:57:29.771042 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:29.770958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:29.771207 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.771123 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 22:57:29.771207 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.771190 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret podName:2e425f64-f9af-4fdf-843f-56276b8636b2 nodeName:}" failed. No retries permitted until 2026-09-07 22:58:01.771173395 +0000 UTC m=+66.263053621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret") pod "global-pull-secret-syncer-sxc47" (UID: "2e425f64-f9af-4fdf-843f-56276b8636b2") : object "kube-system"/"original-pull-secret" not registered Sep 07 22:57:29.872219 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:29.872182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x7wp\" (UniqueName: \"kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp\") pod \"network-check-target-4gstr\" (UID: \"31974305-b5bf-4206-855b-9a084b70a681\") " pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:29.872400 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.872372 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 22:57:29.872400 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.872399 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 22:57:29.872495 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.872413 2575 projected.go:196] Error preparing data for projected volume kube-api-access-8x7wp for pod openshift-network-diagnostics/network-check-target-4gstr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:57:29.872495 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:29.872472 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp podName:31974305-b5bf-4206-855b-9a084b70a681 nodeName:}" failed. No retries permitted until 2026-09-07 22:58:01.872454152 +0000 UTC m=+66.364334388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x7wp" (UniqueName: "kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp") pod "network-check-target-4gstr" (UID: "31974305-b5bf-4206-855b-9a084b70a681") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 22:57:30.213431 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.213181 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-26njv" event={"ID":"a517455b-ea8b-4c95-bf94-1c4b037603e5","Type":"ContainerStarted","Data":"9b51bfbaf4b329a1dcfb21c5e88d35a9a2b8a94b61ca90b25f6f8ab950dbe167"} Sep 07 22:57:30.307234 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.307158 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeReady" Sep 07 22:57:30.307377 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.307285 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 22:57:30.346370 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.346341 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tqhmh"] Sep 07 22:57:30.349130 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.349101 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-svx9r"] Sep 07 22:57:30.349266 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.349132 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.351332 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.351309 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nflgb\"" Sep 07 22:57:30.351421 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.351394 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 22:57:30.351459 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.351419 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 22:57:30.351862 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.351844 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-svx9r" Sep 07 22:57:30.353875 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.353852 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 22:57:30.353993 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.353913 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 22:57:30.353993 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.353929 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cnr5j\"" Sep 07 22:57:30.353993 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.353972 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 22:57:30.358080 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.358058 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tqhmh"] Sep 07 22:57:30.364144 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.364120 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-svx9r"] Sep 07 22:57:30.476921 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.476886 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-config-volume\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.476921 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.476925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-tmp-dir\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.477129 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.476953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.477129 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.477038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/925932eb-71e5-4bae-a747-41d27840279c-cert\") pod \"ingress-canary-svx9r\" (UID: \"925932eb-71e5-4bae-a747-41d27840279c\") " pod="openshift-ingress-canary/ingress-canary-svx9r" Sep 07 22:57:30.477129 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.477067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqmml\" (UniqueName: \"kubernetes.io/projected/925932eb-71e5-4bae-a747-41d27840279c-kube-api-access-bqmml\") pod \"ingress-canary-svx9r\" (UID: \"925932eb-71e5-4bae-a747-41d27840279c\") " pod="openshift-ingress-canary/ingress-canary-svx9r" Sep 07 22:57:30.477129 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.477092 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxr9\" (UniqueName: \"kubernetes.io/projected/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-kube-api-access-pzxr9\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.578261 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.578178 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.578261 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.578238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/925932eb-71e5-4bae-a747-41d27840279c-cert\") pod \"ingress-canary-svx9r\" (UID: \"925932eb-71e5-4bae-a747-41d27840279c\") " pod="openshift-ingress-canary/ingress-canary-svx9r" Sep 07 22:57:30.578261 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.578257 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqmml\" (UniqueName: \"kubernetes.io/projected/925932eb-71e5-4bae-a747-41d27840279c-kube-api-access-bqmml\") pod \"ingress-canary-svx9r\" (UID: \"925932eb-71e5-4bae-a747-41d27840279c\") " pod="openshift-ingress-canary/ingress-canary-svx9r" Sep 07 22:57:30.578511 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.578289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxr9\" (UniqueName: \"kubernetes.io/projected/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-kube-api-access-pzxr9\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.578511 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.578333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-config-volume\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.578511 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:30.578335 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 22:57:30.578511 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:30.578394 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls podName:dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb nodeName:}" failed. No retries permitted until 2026-09-07 22:57:31.078378537 +0000 UTC m=+35.570258761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls") pod "dns-default-tqhmh" (UID: "dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb") : secret "dns-default-metrics-tls" not found Sep 07 22:57:30.578511 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.578468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-tmp-dir\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.578744 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.578729 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-tmp-dir\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.578897 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.578880 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-config-volume\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.582533 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.582506 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/925932eb-71e5-4bae-a747-41d27840279c-cert\") pod \"ingress-canary-svx9r\" (UID: \"925932eb-71e5-4bae-a747-41d27840279c\") " pod="openshift-ingress-canary/ingress-canary-svx9r" Sep 07 22:57:30.586098 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.586067 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxr9\" (UniqueName: \"kubernetes.io/projected/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-kube-api-access-pzxr9\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:30.586214 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.586122 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqmml\" (UniqueName: \"kubernetes.io/projected/925932eb-71e5-4bae-a747-41d27840279c-kube-api-access-bqmml\") pod \"ingress-canary-svx9r\" (UID: \"925932eb-71e5-4bae-a747-41d27840279c\") " pod="openshift-ingress-canary/ingress-canary-svx9r" Sep 07 22:57:30.665131 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.665089 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-svx9r" Sep 07 22:57:30.941641 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:30.941609 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-svx9r"] Sep 07 22:57:30.944615 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:57:30.944589 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925932eb_71e5_4bae_a747_41d27840279c.slice/crio-354f1d5a99cfd71e8c7d9c98ec3ddd5955116d5d632b00ef4c207098f7c21914 WatchSource:0}: Error finding container 354f1d5a99cfd71e8c7d9c98ec3ddd5955116d5d632b00ef4c207098f7c21914: Status 404 returned error can't find the container with id 354f1d5a99cfd71e8c7d9c98ec3ddd5955116d5d632b00ef4c207098f7c21914 Sep 07 22:57:31.025791 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.025745 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:57:31.025791 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.025783 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:57:31.026080 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.025746 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:57:31.028254 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.028231 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-247hl\"" Sep 07 22:57:31.028365 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.028231 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 22:57:31.028365 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.028267 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 22:57:31.029113 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.029092 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 22:57:31.029213 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.029098 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rtt2p\"" Sep 07 22:57:31.029213 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.029126 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 22:57:31.083704 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.083654 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:31.083891 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:31.083831 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 22:57:31.083956 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:31.083911 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls podName:dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb nodeName:}" failed. No retries permitted until 2026-09-07 22:57:32.083889179 +0000 UTC m=+36.575769406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls") pod "dns-default-tqhmh" (UID: "dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb") : secret "dns-default-metrics-tls" not found Sep 07 22:57:31.220976 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.220900 2575 generic.go:356] "Generic (PLEG): container finished" podID="a517455b-ea8b-4c95-bf94-1c4b037603e5" containerID="9b51bfbaf4b329a1dcfb21c5e88d35a9a2b8a94b61ca90b25f6f8ab950dbe167" exitCode=0 Sep 07 22:57:31.221715 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.220977 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-26njv" event={"ID":"a517455b-ea8b-4c95-bf94-1c4b037603e5","Type":"ContainerDied","Data":"9b51bfbaf4b329a1dcfb21c5e88d35a9a2b8a94b61ca90b25f6f8ab950dbe167"} Sep 07 22:57:31.222243 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:31.222223 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-svx9r" event={"ID":"925932eb-71e5-4bae-a747-41d27840279c","Type":"ContainerStarted","Data":"354f1d5a99cfd71e8c7d9c98ec3ddd5955116d5d632b00ef4c207098f7c21914"} Sep 07 22:57:32.092495 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:32.092454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:32.092649 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:32.092616 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 22:57:32.092730 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:32.092679 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls podName:dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb nodeName:}" failed. No retries permitted until 2026-09-07 22:57:34.092663034 +0000 UTC m=+38.584543264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls") pod "dns-default-tqhmh" (UID: "dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb") : secret "dns-default-metrics-tls" not found Sep 07 22:57:32.228603 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:32.228571 2575 generic.go:356] "Generic (PLEG): container finished" podID="a517455b-ea8b-4c95-bf94-1c4b037603e5" containerID="03222eddfee92fd487d0782ff34dd8013f523d0d394b00c0e976d83a8a48f891" exitCode=0 Sep 07 22:57:32.229021 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:32.228625 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-26njv" event={"ID":"a517455b-ea8b-4c95-bf94-1c4b037603e5","Type":"ContainerDied","Data":"03222eddfee92fd487d0782ff34dd8013f523d0d394b00c0e976d83a8a48f891"} Sep 07 22:57:32.982397 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:32.982307 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:33.036463 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:33.036426 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:33.234305 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:33.234228 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-26njv" event={"ID":"a517455b-ea8b-4c95-bf94-1c4b037603e5","Type":"ContainerStarted","Data":"4e698c82eba0b4d6444d450f6e163cec502b3c432a294c528d5e4723da61b30a"} Sep 07 22:57:33.253732 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:33.253669 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-26njv" podStartSLOduration=9.523059633 podStartE2EDuration="37.253652794s" totalImagesPullingTime="27.730593161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:33.252559571 +0000 UTC m=+37.744439818" watchObservedRunningTime="2026-09-07 22:57:33.253652794 +0000 UTC m=+37.745533041" Sep 07 22:57:33.371219 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:33.371193 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:33.470802 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:33.470764 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:34.107794 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:34.107757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:34.108017 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:34.107922 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 22:57:34.108017 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:34.107986 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls podName:dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb nodeName:}" failed. No retries permitted until 2026-09-07 22:57:38.10797051 +0000 UTC m=+42.599850755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls") pod "dns-default-tqhmh" (UID: "dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb") : secret "dns-default-metrics-tls" not found Sep 07 22:57:34.238219 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:34.238172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-svx9r" event={"ID":"925932eb-71e5-4bae-a747-41d27840279c","Type":"ContainerStarted","Data":"faa83cc30dc14c10a835aab1fd81158a454a7ee3a2ae3088c3ba1329af95f602"} Sep 07 22:57:34.252546 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:34.252498 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-svx9r" podStartSLOduration=1.89210858 podStartE2EDuration="4.252481967s" totalImagesPullingTime="2.360373387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:34.25131768 +0000 UTC m=+38.743197927" watchObservedRunningTime="2026-09-07 22:57:34.252481967 +0000 UTC m=+38.744362248" Sep 07 22:57:34.955567 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:34.955500 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:36.525755 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:36.525720 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:36.572380 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:36.572349 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:38.133401 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:38.133367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:38.133835 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:38.133497 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 22:57:38.133835 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:38.133548 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls podName:dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb nodeName:}" failed. No retries permitted until 2026-09-07 22:57:46.133534409 +0000 UTC m=+50.625414634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls") pod "dns-default-tqhmh" (UID: "dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb") : secret "dns-default-metrics-tls" not found Sep 07 22:57:46.190935 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:46.190897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:57:46.191394 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:46.191003 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 22:57:46.191394 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:57:46.191061 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls podName:dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb nodeName:}" failed. No retries permitted until 2026-09-07 22:58:02.191046767 +0000 UTC m=+66.682926991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls") pod "dns-default-tqhmh" (UID: "dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb") : secret "dns-default-metrics-tls" not found Sep 07 22:57:48.268430 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:48.268397 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:48.314669 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:48.314636 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:55.208762 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:55.208726 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvc7g" Sep 07 22:57:55.306654 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:55.306618 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:55.366230 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:55.366195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:57:55.412096 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:57:55.412069 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:58:01.696743 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.696678 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:58:01.699475 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.699453 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 22:58:01.707281 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:58:01.707259 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 22:58:01.707347 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:58:01.707337 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs podName:25fa86da-a99d-4924-9a7a-7cb993ac385c nodeName:}" failed. No retries permitted until 2026-09-07 22:59:05.707318784 +0000 UTC m=+130.199199009 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs") pod "network-metrics-daemon-drkv2" (UID: "25fa86da-a99d-4924-9a7a-7cb993ac385c") : secret "metrics-daemon-secret" not found Sep 07 22:58:01.797817 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.797782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:58:01.800595 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.800577 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 22:58:01.811465 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.811442 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e425f64-f9af-4fdf-843f-56276b8636b2-original-pull-secret\") pod \"global-pull-secret-syncer-sxc47\" (UID: \"2e425f64-f9af-4fdf-843f-56276b8636b2\") " pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:58:01.899097 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.899057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x7wp\" (UniqueName: \"kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp\") pod \"network-check-target-4gstr\" (UID: \"31974305-b5bf-4206-855b-9a084b70a681\") " pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:58:01.901473 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.901452 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 22:58:01.911995 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.911978 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 22:58:01.922893 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.922872 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x7wp\" (UniqueName: \"kubernetes.io/projected/31974305-b5bf-4206-855b-9a084b70a681-kube-api-access-8x7wp\") pod \"network-check-target-4gstr\" (UID: \"31974305-b5bf-4206-855b-9a084b70a681\") " pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:58:01.937442 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.937421 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rtt2p\"" Sep 07 22:58:01.946174 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.946158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sxc47" Sep 07 22:58:01.946262 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:01.946158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:58:02.201362 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:02.201323 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:58:02.201520 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:58:02.201465 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 22:58:02.201558 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:58:02.201527 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls podName:dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb nodeName:}" failed. No retries permitted until 2026-09-07 22:58:34.201511596 +0000 UTC m=+98.693391821 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls") pod "dns-default-tqhmh" (UID: "dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb") : secret "dns-default-metrics-tls" not found Sep 07 22:58:02.242763 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:02.242670 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sxc47"] Sep 07 22:58:02.245824 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:58:02.245799 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e425f64_f9af_4fdf_843f_56276b8636b2.slice/crio-9d11077db922f33046513ba4d892d3fb2dd101a1205ea9cd73b993bdf77c6fe2 WatchSource:0}: Error finding container 9d11077db922f33046513ba4d892d3fb2dd101a1205ea9cd73b993bdf77c6fe2: Status 404 returned error can't find the container with id 9d11077db922f33046513ba4d892d3fb2dd101a1205ea9cd73b993bdf77c6fe2 Sep 07 22:58:02.272100 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:02.272028 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4gstr"] Sep 07 22:58:02.275356 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:58:02.275330 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31974305_b5bf_4206_855b_9a084b70a681.slice/crio-c5d69f19854d34e7f321bb079c5cdca0b03a5729000e4bb3599fd35fb003c840 WatchSource:0}: Error finding container c5d69f19854d34e7f321bb079c5cdca0b03a5729000e4bb3599fd35fb003c840: Status 404 returned error can't find the container with id c5d69f19854d34e7f321bb079c5cdca0b03a5729000e4bb3599fd35fb003c840 Sep 07 22:58:02.314704 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:02.314645 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4gstr" event={"ID":"31974305-b5bf-4206-855b-9a084b70a681","Type":"ContainerStarted","Data":"c5d69f19854d34e7f321bb079c5cdca0b03a5729000e4bb3599fd35fb003c840"} Sep 07 22:58:02.316334 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:02.316306 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sxc47" event={"ID":"2e425f64-f9af-4fdf-843f-56276b8636b2","Type":"ContainerStarted","Data":"9d11077db922f33046513ba4d892d3fb2dd101a1205ea9cd73b993bdf77c6fe2"} Sep 07 22:58:02.876174 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:02.876133 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:58:02.924128 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:02.924059 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:58:07.330745 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:07.330709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4gstr" event={"ID":"31974305-b5bf-4206-855b-9a084b70a681","Type":"ContainerStarted","Data":"dbe830856e13f7cd2127a4d38f502cfe642f7e3d1d075f0463f65924a81d801a"} Sep 07 22:58:07.331293 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:07.330789 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:58:07.332338 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:07.332311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sxc47" event={"ID":"2e425f64-f9af-4fdf-843f-56276b8636b2","Type":"ContainerStarted","Data":"5709638517e4e53ad26f5fcbb4556fd1f6f8af82d1b97034d24475361e5d28cd"} Sep 07 22:58:07.344223 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:07.344165 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4gstr" podStartSLOduration=67.045989977 podStartE2EDuration="1m11.344146934s" totalImagesPullingTime="4.298156957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:58:07.343709754 +0000 UTC m=+71.835590003" watchObservedRunningTime="2026-09-07 22:58:07.344146934 +0000 UTC m=+71.836027176" Sep 07 22:58:07.355484 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:07.355433 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sxc47" podStartSLOduration=67.023884637 podStartE2EDuration="1m11.355416475s" totalImagesPullingTime="4.331531838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:58:07.355249806 +0000 UTC m=+71.847130054" watchObservedRunningTime="2026-09-07 22:58:07.355416475 +0000 UTC m=+71.847296722" Sep 07 22:58:34.208871 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:34.208828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:58:34.209255 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:58:34.208972 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 22:58:34.209255 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:58:34.209045 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls podName:dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb nodeName:}" failed. No retries permitted until 2026-09-07 22:59:38.209029881 +0000 UTC m=+162.700910111 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls") pod "dns-default-tqhmh" (UID: "dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb") : secret "dns-default-metrics-tls" not found Sep 07 22:58:35.142061 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:35.142028 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:58:35.187168 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:35.187138 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 22:58:38.337376 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:38.337341 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4gstr" Sep 07 22:58:46.873761 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.873729 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm"] Sep 07 22:58:46.875271 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.875255 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" Sep 07 22:58:46.877444 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.877422 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 07 22:58:46.878552 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.878524 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 07 22:58:46.878761 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.878719 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xkmbz\"" Sep 07 22:58:46.878761 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.878757 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 07 22:58:46.878873 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.878842 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 07 22:58:46.885528 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.885505 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm"] Sep 07 22:58:46.895876 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.895850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03f9f5cd-546b-4505-8e7a-8048ea591799-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7996b9d94b-2njcm\" (UID: \"03f9f5cd-546b-4505-8e7a-8048ea591799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" Sep 07 22:58:46.896008 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.895917 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzrmc\" (UniqueName: \"kubernetes.io/projected/03f9f5cd-546b-4505-8e7a-8048ea591799-kube-api-access-tzrmc\") pod \"managed-serviceaccount-addon-agent-7996b9d94b-2njcm\" (UID: \"03f9f5cd-546b-4505-8e7a-8048ea591799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" Sep 07 22:58:46.996537 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.996483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrmc\" (UniqueName: \"kubernetes.io/projected/03f9f5cd-546b-4505-8e7a-8048ea591799-kube-api-access-tzrmc\") pod \"managed-serviceaccount-addon-agent-7996b9d94b-2njcm\" (UID: \"03f9f5cd-546b-4505-8e7a-8048ea591799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" Sep 07 22:58:46.996742 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.996562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03f9f5cd-546b-4505-8e7a-8048ea591799-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7996b9d94b-2njcm\" (UID: \"03f9f5cd-546b-4505-8e7a-8048ea591799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" Sep 07 22:58:46.999062 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:46.999029 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03f9f5cd-546b-4505-8e7a-8048ea591799-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7996b9d94b-2njcm\" (UID: \"03f9f5cd-546b-4505-8e7a-8048ea591799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" Sep 07 22:58:47.004396 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:47.004371 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzrmc\" (UniqueName: \"kubernetes.io/projected/03f9f5cd-546b-4505-8e7a-8048ea591799-kube-api-access-tzrmc\") pod \"managed-serviceaccount-addon-agent-7996b9d94b-2njcm\" (UID: \"03f9f5cd-546b-4505-8e7a-8048ea591799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" Sep 07 22:58:47.191664 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:47.191625 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" Sep 07 22:58:47.454046 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:47.453961 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm"] Sep 07 22:58:47.459112 ip-10-0-136-182 kubenswrapper[2575]: W0907 22:58:47.459080 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03f9f5cd_546b_4505_8e7a_8048ea591799.slice/crio-25ebe7e0172d7ed2fec594694babdff6c5063332ce252b1547894eaeeab6d4e0 WatchSource:0}: Error finding container 25ebe7e0172d7ed2fec594694babdff6c5063332ce252b1547894eaeeab6d4e0: Status 404 returned error can't find the container with id 25ebe7e0172d7ed2fec594694babdff6c5063332ce252b1547894eaeeab6d4e0 Sep 07 22:58:48.433385 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:48.433345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" event={"ID":"03f9f5cd-546b-4505-8e7a-8048ea591799","Type":"ContainerStarted","Data":"25ebe7e0172d7ed2fec594694babdff6c5063332ce252b1547894eaeeab6d4e0"} Sep 07 22:58:50.439928 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:50.439891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" event={"ID":"03f9f5cd-546b-4505-8e7a-8048ea591799","Type":"ContainerStarted","Data":"e9265feb97dc752b8d87f01ff9c17955a5c9aebbbf542bbe0fe7561216b792a9"} Sep 07 22:58:50.454138 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:58:50.454083 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" podStartSLOduration=1.990227416 podStartE2EDuration="4.454060739s" totalImagesPullingTime="2.463833323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:58:50.453564252 +0000 UTC m=+114.945444499" watchObservedRunningTime="2026-09-07 22:58:50.454060739 +0000 UTC m=+114.945941001" Sep 07 22:59:05.727778 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:59:05.727732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 22:59:05.728187 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:59:05.727845 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 22:59:05.728187 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:59:05.727910 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs podName:25fa86da-a99d-4924-9a7a-7cb993ac385c nodeName:}" failed. No retries permitted until 2026-09-07 23:01:07.727895225 +0000 UTC m=+252.219775450 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs") pod "network-metrics-daemon-drkv2" (UID: "25fa86da-a99d-4924-9a7a-7cb993ac385c") : secret "metrics-daemon-secret" not found Sep 07 22:59:33.359442 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:59:33.359342 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tqhmh" podUID="dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb" Sep 07 22:59:33.539609 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:59:33.539580 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqhmh" Sep 07 22:59:34.051086 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:59:34.051041 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 22:59:38.254587 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:59:38.254538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 22:59:38.255126 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:59:38.254700 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 22:59:38.255126 ip-10-0-136-182 kubenswrapper[2575]: E0907 22:59:38.254792 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls podName:dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb nodeName:}" failed. No retries permitted until 2026-09-07 23:01:40.254774174 +0000 UTC m=+284.746654404 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls") pod "dns-default-tqhmh" (UID: "dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb") : secret "dns-default-metrics-tls" not found Sep 07 22:59:49.025556 ip-10-0-136-182 kubenswrapper[2575]: I0907 22:59:49.025462 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 23:00:47.503390 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:00:47.503355 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:00:49.797360 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:00:49.797322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:00:50.725216 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:00:50.725181 2575 generic.go:356] "Generic (PLEG): container finished" podID="03f9f5cd-546b-4505-8e7a-8048ea591799" containerID="e9265feb97dc752b8d87f01ff9c17955a5c9aebbbf542bbe0fe7561216b792a9" exitCode=255 Sep 07 23:00:50.725382 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:00:50.725230 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" event={"ID":"03f9f5cd-546b-4505-8e7a-8048ea591799","Type":"ContainerDied","Data":"e9265feb97dc752b8d87f01ff9c17955a5c9aebbbf542bbe0fe7561216b792a9"} Sep 07 23:00:50.730616 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:00:50.730596 2575 scope.go:117] "RemoveContainer" containerID="e9265feb97dc752b8d87f01ff9c17955a5c9aebbbf542bbe0fe7561216b792a9" Sep 07 23:00:51.730148 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:00:51.730109 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7996b9d94b-2njcm" event={"ID":"03f9f5cd-546b-4505-8e7a-8048ea591799","Type":"ContainerStarted","Data":"56ab913513f658d796bcf23c8ba97a2aca821b0bff04934cd52602c5e4168104"} Sep 07 23:01:07.761672 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:07.761623 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 23:01:07.762162 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:07.761798 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 23:01:07.762162 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:07.761873 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs podName:25fa86da-a99d-4924-9a7a-7cb993ac385c nodeName:}" failed. No retries permitted until 2026-09-07 23:03:09.761855848 +0000 UTC m=+374.253736074 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs") pod "network-metrics-daemon-drkv2" (UID: "25fa86da-a99d-4924-9a7a-7cb993ac385c") : secret "metrics-daemon-secret" not found Sep 07 23:01:08.348220 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.348080 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-fft2n"] Sep 07 23:01:08.351009 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.350993 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn"] Sep 07 23:01:08.351131 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.351110 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.353466 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.353448 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64f97c8c4f-mj54p"] Sep 07 23:01:08.353597 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.353559 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:08.353847 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.353817 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 07 23:01:08.353947 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.353867 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 23:01:08.354031 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.354013 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 23:01:08.354158 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.354140 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kkpv8\"" Sep 07 23:01:08.354236 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.354219 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 07 23:01:08.356050 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.356034 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.357202 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.357185 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 23:01:08.358055 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.358035 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 07 23:01:08.358055 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.358053 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 23:01:08.358668 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.358270 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8vmjb\"" Sep 07 23:01:08.358808 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.358713 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 07 23:01:08.359184 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.359167 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nrmp6\"" Sep 07 23:01:08.359443 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.359417 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 07 23:01:08.359500 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.359463 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 07 23:01:08.359541 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.359504 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 07 23:01:08.360546 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.360526 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 07 23:01:08.365365 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.365347 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-fft2n"] Sep 07 23:01:08.367611 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.367588 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64f97c8c4f-mj54p"] Sep 07 23:01:08.368564 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.368544 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 07 23:01:08.373624 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.373604 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn"] Sep 07 23:01:08.442740 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.442704 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb"] Sep 07 23:01:08.445562 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.445543 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp"] Sep 07 23:01:08.445701 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.445668 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.448082 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.448064 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-h949s"] Sep 07 23:01:08.448201 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.448187 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp" Sep 07 23:01:08.449783 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.449590 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 07 23:01:08.449783 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.449658 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gc5zq\"" Sep 07 23:01:08.449783 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.449766 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 07 23:01:08.450059 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.450040 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 07 23:01:08.451393 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.450782 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-h949s" Sep 07 23:01:08.451393 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.450799 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 07 23:01:08.451393 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.450870 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 07 23:01:08.451393 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.451182 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lg956\"" Sep 07 23:01:08.451635 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.450871 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 07 23:01:08.452920 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.452811 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7"] Sep 07 23:01:08.454165 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.454145 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gvmtt\"" Sep 07 23:01:08.457463 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.457445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:08.458111 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.458089 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp"] Sep 07 23:01:08.458940 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.458919 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb"] Sep 07 23:01:08.459950 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.459891 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 07 23:01:08.459950 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.459895 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7js5d\"" Sep 07 23:01:08.459950 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.459935 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 07 23:01:08.460151 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.459919 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 07 23:01:08.460151 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.460028 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-h949s"] Sep 07 23:01:08.463202 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.463183 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7"] Sep 07 23:01:08.466558 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-image-registry-private-configuration\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.466658 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/33c7561a-c7ee-4e37-836f-2b3623d89c25-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:08.466658 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e24119-3c8f-4d2b-90a2-15065f0002cf-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.466658 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e24119-3c8f-4d2b-90a2-15065f0002cf-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.466658 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:08.466893 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-installation-pull-secrets\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.466893 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcms8\" (UniqueName: \"kubernetes.io/projected/91e24119-3c8f-4d2b-90a2-15065f0002cf-kube-api-access-hcms8\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.466893 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466751 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znj7s\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-kube-api-access-znj7s\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.466893 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-registry-certificates\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.466893 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.466893 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/15cbec64-3e98-401e-952e-4bc3af67730d-ca-trust-extracted\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.467136 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-bound-sa-token\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.467136 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.466987 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-trusted-ca\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.467136 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.467018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znsdf\" (UniqueName: \"kubernetes.io/projected/33c7561a-c7ee-4e37-836f-2b3623d89c25-kube-api-access-znsdf\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:08.467136 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.467035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/91e24119-3c8f-4d2b-90a2-15065f0002cf-serving-cert\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.467136 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.467053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91e24119-3c8f-4d2b-90a2-15065f0002cf-tmp\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.467136 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.467074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/91e24119-3c8f-4d2b-90a2-15065f0002cf-snapshots\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.568010 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.567964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.568010 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568009 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/91e24119-3c8f-4d2b-90a2-15065f0002cf-serving-cert\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.568270 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568032 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-bound-sa-token\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.568270 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:08.568103 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 23:01:08.568270 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:08.568124 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f97c8c4f-mj54p: secret "image-registry-tls" not found Sep 07 23:01:08.568270 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568167 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-trusted-ca\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.568270 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:08.568179 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls podName:15cbec64-3e98-401e-952e-4bc3af67730d nodeName:}" failed. No retries permitted until 2026-09-07 23:01:09.068164128 +0000 UTC m=+253.560044369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls") pod "image-registry-64f97c8c4f-mj54p" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d") : secret "image-registry-tls" not found Sep 07 23:01:08.568270 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568214 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vklvw\" (UniqueName: \"kubernetes.io/projected/64e41cdc-3030-478d-bce9-e6f5121c9dc8-kube-api-access-vklvw\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l95qb\" (UID: \"64e41cdc-3030-478d-bce9-e6f5121c9dc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.568270 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/91e24119-3c8f-4d2b-90a2-15065f0002cf-snapshots\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.568270 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:08.568648 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568358 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcms8\" (UniqueName: \"kubernetes.io/projected/91e24119-3c8f-4d2b-90a2-15065f0002cf-kube-api-access-hcms8\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.568648 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:08.568648 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-installation-pull-secrets\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.568648 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568474 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-registry-certificates\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.568648 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/15cbec64-3e98-401e-952e-4bc3af67730d-ca-trust-extracted\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.568648 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:08.568528 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:08.568648 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64e41cdc-3030-478d-bce9-e6f5121c9dc8-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l95qb\" (UID: \"64e41cdc-3030-478d-bce9-e6f5121c9dc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.568648 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znsdf\" (UniqueName: \"kubernetes.io/projected/33c7561a-c7ee-4e37-836f-2b3623d89c25-kube-api-access-znsdf\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:08.568648 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:08.568593 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls podName:33c7561a-c7ee-4e37-836f-2b3623d89c25 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:09.068574788 +0000 UTC m=+253.560455026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-27pzn" (UID: "33c7561a-c7ee-4e37-836f-2b3623d89c25") : secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:08.568648 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568629 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91e24119-3c8f-4d2b-90a2-15065f0002cf-tmp\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e24119-3c8f-4d2b-90a2-15065f0002cf-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568714 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-image-registry-private-configuration\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568743 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/33c7561a-c7ee-4e37-836f-2b3623d89c25-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e24119-3c8f-4d2b-90a2-15065f0002cf-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjdsk\" (UniqueName: \"kubernetes.io/projected/a24aa2cf-f380-4dcf-9f2e-837be2f314a3-kube-api-access-kjdsk\") pod \"network-check-source-685456655f-h949s\" (UID: \"a24aa2cf-f380-4dcf-9f2e-837be2f314a3\") " pod="openshift-network-diagnostics/network-check-source-685456655f-h949s" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568831 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46zlm\" (UniqueName: \"kubernetes.io/projected/b58284b9-6b8b-4654-903e-18625b2eae39-kube-api-access-46zlm\") pod \"volume-data-source-validator-695c895bd6-8l2gp\" (UID: \"b58284b9-6b8b-4654-903e-18625b2eae39\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znj7s\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-kube-api-access-znj7s\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64e41cdc-3030-478d-bce9-e6f5121c9dc8-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l95qb\" (UID: \"64e41cdc-3030-478d-bce9-e6f5121c9dc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/91e24119-3c8f-4d2b-90a2-15065f0002cf-snapshots\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.568918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v82z7\" (UniqueName: \"kubernetes.io/projected/fc803d9b-8786-4ec9-a27d-63a93edd4c32-kube-api-access-v82z7\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.569013 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-registry-certificates\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.569170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.569105 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/15cbec64-3e98-401e-952e-4bc3af67730d-ca-trust-extracted\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.569774 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.569351 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-trusted-ca\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.569774 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.569424 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91e24119-3c8f-4d2b-90a2-15065f0002cf-tmp\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.569774 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.569528 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e24119-3c8f-4d2b-90a2-15065f0002cf-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.569774 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.569647 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/33c7561a-c7ee-4e37-836f-2b3623d89c25-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:08.570167 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.570145 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e24119-3c8f-4d2b-90a2-15065f0002cf-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.570975 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.570953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/91e24119-3c8f-4d2b-90a2-15065f0002cf-serving-cert\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.571058 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.571036 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-installation-pull-secrets\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.571398 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.571380 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-image-registry-private-configuration\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.578299 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.578271 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-bound-sa-token\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.578601 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.578576 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znsdf\" (UniqueName: \"kubernetes.io/projected/33c7561a-c7ee-4e37-836f-2b3623d89c25-kube-api-access-znsdf\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:08.578784 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.578765 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znj7s\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-kube-api-access-znj7s\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:08.579416 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.579393 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcms8\" (UniqueName: \"kubernetes.io/projected/91e24119-3c8f-4d2b-90a2-15065f0002cf-kube-api-access-hcms8\") pod \"insights-operator-76bcd6ccf5-fft2n\" (UID: \"91e24119-3c8f-4d2b-90a2-15065f0002cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.605748 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.605678 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:08.662783 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.662758 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" Sep 07 23:01:08.669904 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.669883 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjdsk\" (UniqueName: \"kubernetes.io/projected/a24aa2cf-f380-4dcf-9f2e-837be2f314a3-kube-api-access-kjdsk\") pod \"network-check-source-685456655f-h949s\" (UID: \"a24aa2cf-f380-4dcf-9f2e-837be2f314a3\") " pod="openshift-network-diagnostics/network-check-source-685456655f-h949s" Sep 07 23:01:08.669973 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.669916 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46zlm\" (UniqueName: \"kubernetes.io/projected/b58284b9-6b8b-4654-903e-18625b2eae39-kube-api-access-46zlm\") pod \"volume-data-source-validator-695c895bd6-8l2gp\" (UID: \"b58284b9-6b8b-4654-903e-18625b2eae39\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp" Sep 07 23:01:08.669973 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.669933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64e41cdc-3030-478d-bce9-e6f5121c9dc8-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l95qb\" (UID: \"64e41cdc-3030-478d-bce9-e6f5121c9dc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.669973 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.669948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v82z7\" (UniqueName: \"kubernetes.io/projected/fc803d9b-8786-4ec9-a27d-63a93edd4c32-kube-api-access-v82z7\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:08.670220 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.670199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vklvw\" (UniqueName: \"kubernetes.io/projected/64e41cdc-3030-478d-bce9-e6f5121c9dc8-kube-api-access-vklvw\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l95qb\" (UID: \"64e41cdc-3030-478d-bce9-e6f5121c9dc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.670309 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.670237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:08.670363 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.670313 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64e41cdc-3030-478d-bce9-e6f5121c9dc8-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l95qb\" (UID: \"64e41cdc-3030-478d-bce9-e6f5121c9dc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.670416 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:08.670395 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 23:01:08.670463 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:08.670457 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls podName:fc803d9b-8786-4ec9-a27d-63a93edd4c32 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:09.170441705 +0000 UTC m=+253.662321944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lqmd7" (UID: "fc803d9b-8786-4ec9-a27d-63a93edd4c32") : secret "samples-operator-tls" not found Sep 07 23:01:08.670811 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.670792 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64e41cdc-3030-478d-bce9-e6f5121c9dc8-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l95qb\" (UID: \"64e41cdc-3030-478d-bce9-e6f5121c9dc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.672407 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.672382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:08.672598 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.672577 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64e41cdc-3030-478d-bce9-e6f5121c9dc8-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l95qb\" (UID: \"64e41cdc-3030-478d-bce9-e6f5121c9dc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.679052 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.679028 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjdsk\" (UniqueName: \"kubernetes.io/projected/a24aa2cf-f380-4dcf-9f2e-837be2f314a3-kube-api-access-kjdsk\") pod \"network-check-source-685456655f-h949s\" (UID: \"a24aa2cf-f380-4dcf-9f2e-837be2f314a3\") " pod="openshift-network-diagnostics/network-check-source-685456655f-h949s" Sep 07 23:01:08.679317 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.679299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46zlm\" (UniqueName: \"kubernetes.io/projected/b58284b9-6b8b-4654-903e-18625b2eae39-kube-api-access-46zlm\") pod \"volume-data-source-validator-695c895bd6-8l2gp\" (UID: \"b58284b9-6b8b-4654-903e-18625b2eae39\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp" Sep 07 23:01:08.679482 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.679465 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vklvw\" (UniqueName: \"kubernetes.io/projected/64e41cdc-3030-478d-bce9-e6f5121c9dc8-kube-api-access-vklvw\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l95qb\" (UID: \"64e41cdc-3030-478d-bce9-e6f5121c9dc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.679877 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.679856 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v82z7\" (UniqueName: \"kubernetes.io/projected/fc803d9b-8786-4ec9-a27d-63a93edd4c32-kube-api-access-v82z7\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:08.759209 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.759154 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" Sep 07 23:01:08.767452 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.767400 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp" Sep 07 23:01:08.773164 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.773132 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-h949s" Sep 07 23:01:08.929437 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:08.929410 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-fft2n"] Sep 07 23:01:08.932518 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:08.932489 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e24119_3c8f_4d2b_90a2_15065f0002cf.slice/crio-092231aa093423d3606a3800e0a19529cf23c4e3887ec785deccdd52cbd588cb WatchSource:0}: Error finding container 092231aa093423d3606a3800e0a19529cf23c4e3887ec785deccdd52cbd588cb: Status 404 returned error can't find the container with id 092231aa093423d3606a3800e0a19529cf23c4e3887ec785deccdd52cbd588cb Sep 07 23:01:09.033004 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.032974 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb"] Sep 07 23:01:09.035517 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:09.035490 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e41cdc_3030_478d_bce9_e6f5121c9dc8.slice/crio-62df589b9432b67ee1ed02020aec9fa8836ec39f52236fdcadafd1cb93553592 WatchSource:0}: Error finding container 62df589b9432b67ee1ed02020aec9fa8836ec39f52236fdcadafd1cb93553592: Status 404 returned error can't find the container with id 62df589b9432b67ee1ed02020aec9fa8836ec39f52236fdcadafd1cb93553592 Sep 07 23:01:09.038597 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.038576 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp"] Sep 07 23:01:09.041678 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:09.041651 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58284b9_6b8b_4654_903e_18625b2eae39.slice/crio-662578c218d8d7c18fe70cd120f6c4ed06399516b126f8b5e1e74a9e0d048e23 WatchSource:0}: Error finding container 662578c218d8d7c18fe70cd120f6c4ed06399516b126f8b5e1e74a9e0d048e23: Status 404 returned error can't find the container with id 662578c218d8d7c18fe70cd120f6c4ed06399516b126f8b5e1e74a9e0d048e23 Sep 07 23:01:09.057480 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.057452 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-h949s"] Sep 07 23:01:09.060075 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:09.060051 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24aa2cf_f380_4dcf_9f2e_837be2f314a3.slice/crio-812ea4b315dae9c29046dbe85916ff891097dc6baf28859db8cda1989c277403 WatchSource:0}: Error finding container 812ea4b315dae9c29046dbe85916ff891097dc6baf28859db8cda1989c277403: Status 404 returned error can't find the container with id 812ea4b315dae9c29046dbe85916ff891097dc6baf28859db8cda1989c277403 Sep 07 23:01:09.074407 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.074383 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:09.074509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.074448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:09.074568 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:09.074550 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:09.074639 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:09.074625 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls podName:33c7561a-c7ee-4e37-836f-2b3623d89c25 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:10.074604147 +0000 UTC m=+254.566484387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-27pzn" (UID: "33c7561a-c7ee-4e37-836f-2b3623d89c25") : secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:09.074639 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:09.074555 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 23:01:09.074769 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:09.074645 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f97c8c4f-mj54p: secret "image-registry-tls" not found Sep 07 23:01:09.074769 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:09.074680 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls podName:15cbec64-3e98-401e-952e-4bc3af67730d nodeName:}" failed. No retries permitted until 2026-09-07 23:01:10.074669801 +0000 UTC m=+254.566550027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls") pod "image-registry-64f97c8c4f-mj54p" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d") : secret "image-registry-tls" not found Sep 07 23:01:09.175086 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.175042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:09.175257 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:09.175165 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 23:01:09.175257 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:09.175227 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls podName:fc803d9b-8786-4ec9-a27d-63a93edd4c32 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:10.175210143 +0000 UTC m=+254.667090387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lqmd7" (UID: "fc803d9b-8786-4ec9-a27d-63a93edd4c32") : secret "samples-operator-tls" not found Sep 07 23:01:09.788390 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.788349 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-h949s" event={"ID":"a24aa2cf-f380-4dcf-9f2e-837be2f314a3","Type":"ContainerStarted","Data":"238cd0b796c4ee10b95b28b7829e2dc8eab6f194ec3e6a1029988497646439a5"} Sep 07 23:01:09.788863 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.788409 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-h949s" event={"ID":"a24aa2cf-f380-4dcf-9f2e-837be2f314a3","Type":"ContainerStarted","Data":"812ea4b315dae9c29046dbe85916ff891097dc6baf28859db8cda1989c277403"} Sep 07 23:01:09.790704 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.790663 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp" event={"ID":"b58284b9-6b8b-4654-903e-18625b2eae39","Type":"ContainerStarted","Data":"662578c218d8d7c18fe70cd120f6c4ed06399516b126f8b5e1e74a9e0d048e23"} Sep 07 23:01:09.792701 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.792652 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" event={"ID":"91e24119-3c8f-4d2b-90a2-15065f0002cf","Type":"ContainerStarted","Data":"092231aa093423d3606a3800e0a19529cf23c4e3887ec785deccdd52cbd588cb"} Sep 07 23:01:09.794093 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.794044 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" event={"ID":"64e41cdc-3030-478d-bce9-e6f5121c9dc8","Type":"ContainerStarted","Data":"62df589b9432b67ee1ed02020aec9fa8836ec39f52236fdcadafd1cb93553592"} Sep 07 23:01:09.804025 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:09.803970 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-h949s" podStartSLOduration=1.803950994 podStartE2EDuration="1.803950994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:09.802290064 +0000 UTC m=+254.294170313" watchObservedRunningTime="2026-09-07 23:01:09.803950994 +0000 UTC m=+254.295831236" Sep 07 23:01:10.083579 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:10.083043 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:10.083579 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:10.083136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:10.083579 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:10.083448 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 23:01:10.083579 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:10.083466 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f97c8c4f-mj54p: secret "image-registry-tls" not found Sep 07 23:01:10.083579 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:10.083452 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:10.083579 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:10.083518 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls podName:33c7561a-c7ee-4e37-836f-2b3623d89c25 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:12.08349967 +0000 UTC m=+256.575379900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-27pzn" (UID: "33c7561a-c7ee-4e37-836f-2b3623d89c25") : secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:10.083579 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:10.083532 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls podName:15cbec64-3e98-401e-952e-4bc3af67730d nodeName:}" failed. No retries permitted until 2026-09-07 23:01:12.083525194 +0000 UTC m=+256.575405420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls") pod "image-registry-64f97c8c4f-mj54p" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d") : secret "image-registry-tls" not found Sep 07 23:01:10.183831 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:10.183791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:10.184005 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:10.183962 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 23:01:10.184057 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:10.184025 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls podName:fc803d9b-8786-4ec9-a27d-63a93edd4c32 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:12.18400583 +0000 UTC m=+256.675886060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lqmd7" (UID: "fc803d9b-8786-4ec9-a27d-63a93edd4c32") : secret "samples-operator-tls" not found Sep 07 23:01:10.799199 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:10.799159 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp" event={"ID":"b58284b9-6b8b-4654-903e-18625b2eae39","Type":"ContainerStarted","Data":"8b161b7700158115e09d22a1822c608207e595c437a7147f5f3ba59c4cd63dcf"} Sep 07 23:01:10.813492 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:10.813434 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8l2gp" podStartSLOduration=1.474851374 podStartE2EDuration="2.813413452s" totalImagesPullingTime="1.338562078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:10.812231785 +0000 UTC m=+255.304112029" watchObservedRunningTime="2026-09-07 23:01:10.813413452 +0000 UTC m=+255.305293700" Sep 07 23:01:10.880739 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:10.880705 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:11.803868 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:11.803759 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" event={"ID":"64e41cdc-3030-478d-bce9-e6f5121c9dc8","Type":"ContainerStarted","Data":"001f3fb3625adb797c1dde821377e4ab427041e0025e4a182f7d5974ffa6d77e"} Sep 07 23:01:11.805286 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:11.805262 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" event={"ID":"91e24119-3c8f-4d2b-90a2-15065f0002cf","Type":"ContainerStarted","Data":"5c966c3fa83ba9d552fcbf810bef93e119273388b73ba6ccf3af75c940e32e99"} Sep 07 23:01:11.819295 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:11.819244 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" podStartSLOduration=1.343035397 podStartE2EDuration="3.819228619s" totalImagesPullingTime="2.476193222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:11.818636956 +0000 UTC m=+256.310517204" watchObservedRunningTime="2026-09-07 23:01:11.819228619 +0000 UTC m=+256.311109184" Sep 07 23:01:11.833462 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:11.833396 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" podStartSLOduration=1.256708558 podStartE2EDuration="3.833375555s" totalImagesPullingTime="2.576666997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:11.832102459 +0000 UTC m=+256.323982708" watchObservedRunningTime="2026-09-07 23:01:11.833375555 +0000 UTC m=+256.325255803" Sep 07 23:01:12.100151 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.100061 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:12.100151 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.100143 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:12.100375 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:12.100221 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 23:01:12.100375 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:12.100247 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f97c8c4f-mj54p: secret "image-registry-tls" not found Sep 07 23:01:12.100375 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:12.100256 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:12.100375 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:12.100310 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls podName:15cbec64-3e98-401e-952e-4bc3af67730d nodeName:}" failed. No retries permitted until 2026-09-07 23:01:16.100290398 +0000 UTC m=+260.592170637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls") pod "image-registry-64f97c8c4f-mj54p" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d") : secret "image-registry-tls" not found Sep 07 23:01:12.100375 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:12.100328 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls podName:33c7561a-c7ee-4e37-836f-2b3623d89c25 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:16.100318587 +0000 UTC m=+260.592198817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-27pzn" (UID: "33c7561a-c7ee-4e37-836f-2b3623d89c25") : secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:12.200887 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.200855 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:12.201066 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:12.201024 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 23:01:12.201136 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:12.201104 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls podName:fc803d9b-8786-4ec9-a27d-63a93edd4c32 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:16.201081769 +0000 UTC m=+260.692962016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lqmd7" (UID: "fc803d9b-8786-4ec9-a27d-63a93edd4c32") : secret "samples-operator-tls" not found Sep 07 23:01:12.679895 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.679854 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:12.778329 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.778287 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:12.788252 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.788216 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mcfdw"] Sep 07 23:01:12.791651 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.791623 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:12.794058 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.794033 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 23:01:12.794190 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.794060 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 23:01:12.794190 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.794046 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s9lzk\"" Sep 07 23:01:12.802916 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.802888 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mcfdw"] Sep 07 23:01:12.847480 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.847445 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:12.907136 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.907098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76ca2144-5f97-433b-a453-38003496f82a-crio-socket\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:12.907311 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.907194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:12.907408 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.907340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:12.907467 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.907427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76ca2144-5f97-433b-a453-38003496f82a-data-volume\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:12.907552 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:12.907530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8bj6\" (UniqueName: \"kubernetes.io/projected/76ca2144-5f97-433b-a453-38003496f82a-kube-api-access-g8bj6\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.008757 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.008648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.008757 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.008756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76ca2144-5f97-433b-a453-38003496f82a-data-volume\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.009090 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.008802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8bj6\" (UniqueName: \"kubernetes.io/projected/76ca2144-5f97-433b-a453-38003496f82a-kube-api-access-g8bj6\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.009090 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:13.008821 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 23:01:13.009090 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.008852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76ca2144-5f97-433b-a453-38003496f82a-crio-socket\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.009090 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.008886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.009090 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:13.008915 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:13.508892099 +0000 UTC m=+258.000772327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : secret "insights-runtime-extractor-tls" not found Sep 07 23:01:13.009090 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:13.008948 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 23:01:13.009090 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.008978 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76ca2144-5f97-433b-a453-38003496f82a-crio-socket\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.009090 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:13.009004 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:13.508989147 +0000 UTC m=+258.000869376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : configmap "kube-rbac-proxy" not found Sep 07 23:01:13.009340 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.009112 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76ca2144-5f97-433b-a453-38003496f82a-data-volume\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.019108 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.019085 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8bj6\" (UniqueName: \"kubernetes.io/projected/76ca2144-5f97-433b-a453-38003496f82a-kube-api-access-g8bj6\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.143841 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.143802 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:13.243709 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.243647 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:13.338659 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.338561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:13.394817 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.394781 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:13.445744 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.445714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:13.513117 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.513077 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.513291 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:13.513142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:13.513291 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:13.513196 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 23:01:13.513291 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:13.513260 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:14.513244552 +0000 UTC m=+259.005124777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : configmap "kube-rbac-proxy" not found Sep 07 23:01:13.513291 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:13.513259 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 23:01:13.513291 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:13.513289 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:14.51328097 +0000 UTC m=+259.005161195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : secret "insights-runtime-extractor-tls" not found Sep 07 23:01:14.519679 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.519644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:14.520055 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.519769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:14.520055 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:14.519784 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 23:01:14.520055 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:14.519836 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 23:01:14.520055 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:14.519845 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:16.519828038 +0000 UTC m=+261.011708263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : secret "insights-runtime-extractor-tls" not found Sep 07 23:01:14.520055 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:14.519875 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:16.519863399 +0000 UTC m=+261.011743652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : configmap "kube-rbac-proxy" not found Sep 07 23:01:14.622771 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.622734 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:14.841822 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.841745 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dznnd_cd75c66f-215a-4eb3-b9aa-ae24f452593b/dns-node-resolver/0.log" Sep 07 23:01:14.949115 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.949078 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-7nz6x"] Sep 07 23:01:14.952219 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.952198 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:14.954582 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.954555 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 07 23:01:14.954582 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.954574 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 07 23:01:14.955467 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.955445 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 07 23:01:14.955563 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.955470 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sk8m7\"" Sep 07 23:01:14.955563 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.955516 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 07 23:01:14.964317 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.964293 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-7nz6x"] Sep 07 23:01:14.987119 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:14.987084 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:15.023972 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.023940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cd9346a3-91e8-4f01-89c2-0193af3a265e-signing-cabundle\") pod \"service-ca-75d99c484-7nz6x\" (UID: \"cd9346a3-91e8-4f01-89c2-0193af3a265e\") " pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:15.024065 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.023992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cd9346a3-91e8-4f01-89c2-0193af3a265e-signing-key\") pod \"service-ca-75d99c484-7nz6x\" (UID: \"cd9346a3-91e8-4f01-89c2-0193af3a265e\") " pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:15.024149 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.024132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q2gz\" (UniqueName: \"kubernetes.io/projected/cd9346a3-91e8-4f01-89c2-0193af3a265e-kube-api-access-7q2gz\") pod \"service-ca-75d99c484-7nz6x\" (UID: \"cd9346a3-91e8-4f01-89c2-0193af3a265e\") " pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:15.046028 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.045999 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:15.125185 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.125098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q2gz\" (UniqueName: \"kubernetes.io/projected/cd9346a3-91e8-4f01-89c2-0193af3a265e-kube-api-access-7q2gz\") pod \"service-ca-75d99c484-7nz6x\" (UID: \"cd9346a3-91e8-4f01-89c2-0193af3a265e\") " pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:15.125185 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.125151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cd9346a3-91e8-4f01-89c2-0193af3a265e-signing-cabundle\") pod \"service-ca-75d99c484-7nz6x\" (UID: \"cd9346a3-91e8-4f01-89c2-0193af3a265e\") " pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:15.125381 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.125287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cd9346a3-91e8-4f01-89c2-0193af3a265e-signing-key\") pod \"service-ca-75d99c484-7nz6x\" (UID: \"cd9346a3-91e8-4f01-89c2-0193af3a265e\") " pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:15.125791 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.125772 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cd9346a3-91e8-4f01-89c2-0193af3a265e-signing-cabundle\") pod \"service-ca-75d99c484-7nz6x\" (UID: \"cd9346a3-91e8-4f01-89c2-0193af3a265e\") " pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:15.127647 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.127626 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cd9346a3-91e8-4f01-89c2-0193af3a265e-signing-key\") pod \"service-ca-75d99c484-7nz6x\" (UID: \"cd9346a3-91e8-4f01-89c2-0193af3a265e\") " pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:15.134002 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.133977 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q2gz\" (UniqueName: \"kubernetes.io/projected/cd9346a3-91e8-4f01-89c2-0193af3a265e-kube-api-access-7q2gz\") pod \"service-ca-75d99c484-7nz6x\" (UID: \"cd9346a3-91e8-4f01-89c2-0193af3a265e\") " pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:15.263319 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.263287 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-7nz6x" Sep 07 23:01:15.530218 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.530035 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-7nz6x"] Sep 07 23:01:15.533066 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:15.533041 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd9346a3_91e8_4f01_89c2_0193af3a265e.slice/crio-b8cda1c1add56266ef02eec3450f5097f05e3424954dece9c48b2dfb5f23ca30 WatchSource:0}: Error finding container b8cda1c1add56266ef02eec3450f5097f05e3424954dece9c48b2dfb5f23ca30: Status 404 returned error can't find the container with id b8cda1c1add56266ef02eec3450f5097f05e3424954dece9c48b2dfb5f23ca30 Sep 07 23:01:15.819556 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:15.819474 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-7nz6x" event={"ID":"cd9346a3-91e8-4f01-89c2-0193af3a265e","Type":"ContainerStarted","Data":"b8cda1c1add56266ef02eec3450f5097f05e3424954dece9c48b2dfb5f23ca30"} Sep 07 23:01:16.042149 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:16.042119 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jzfnw_da3011ac-9e6b-4594-9704-ae1167d64bea/node-ca/0.log" Sep 07 23:01:16.051408 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:16.051374 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:16.135004 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:16.134908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:16.135172 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:16.135028 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:16.135172 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.135059 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 23:01:16.135172 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.135083 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f97c8c4f-mj54p: secret "image-registry-tls" not found Sep 07 23:01:16.135172 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.135141 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls podName:15cbec64-3e98-401e-952e-4bc3af67730d nodeName:}" failed. No retries permitted until 2026-09-07 23:01:24.135120308 +0000 UTC m=+268.627000550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls") pod "image-registry-64f97c8c4f-mj54p" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d") : secret "image-registry-tls" not found Sep 07 23:01:16.135172 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.135154 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:16.135431 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.135209 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls podName:33c7561a-c7ee-4e37-836f-2b3623d89c25 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:24.135191419 +0000 UTC m=+268.627071660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-27pzn" (UID: "33c7561a-c7ee-4e37-836f-2b3623d89c25") : secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:16.235799 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:16.235751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:16.235988 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.235908 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 23:01:16.235988 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.235984 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls podName:fc803d9b-8786-4ec9-a27d-63a93edd4c32 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:24.235964061 +0000 UTC m=+268.727844303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lqmd7" (UID: "fc803d9b-8786-4ec9-a27d-63a93edd4c32") : secret "samples-operator-tls" not found Sep 07 23:01:16.538555 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:16.538522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:16.539038 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:16.538593 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:16.539038 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.538660 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 23:01:16.539038 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.538734 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 23:01:16.539038 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.538754 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:20.538731437 +0000 UTC m=+265.030611661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : configmap "kube-rbac-proxy" not found Sep 07 23:01:16.539038 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:16.538777 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:20.538766156 +0000 UTC m=+265.030646381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : secret "insights-runtime-extractor-tls" not found Sep 07 23:01:16.642220 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:16.642184 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-svx9r_925932eb-71e5-4bae-a747-41d27840279c/serve-healthcheck-canary/0.log" Sep 07 23:01:17.827207 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:17.827108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-7nz6x" event={"ID":"cd9346a3-91e8-4f01-89c2-0193af3a265e","Type":"ContainerStarted","Data":"073ecb8066459cc389dd21f71166a5335984fbc56c3df4ca09ed46c19c45a26b"} Sep 07 23:01:17.840899 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:17.840847 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-7nz6x" podStartSLOduration=1.9509268579999999 podStartE2EDuration="3.840801532s" totalImagesPullingTime="1.889874674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:17.840188914 +0000 UTC m=+262.332069167" watchObservedRunningTime="2026-09-07 23:01:17.840801532 +0000 UTC m=+262.332681780" Sep 07 23:01:18.579870 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:18.579836 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:18.846144 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:18.846103 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:18.943004 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:18.942967 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:19.083583 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:19.083551 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:19.162755 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:19.162723 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:19.283351 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:19.283304 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:20.476109 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:20.476073 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:20.576214 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:20.576173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:20.576417 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:20.576247 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:20.576417 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:20.576306 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 23:01:20.576417 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:20.576380 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:28.576362902 +0000 UTC m=+273.068243128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : configmap "kube-rbac-proxy" not found Sep 07 23:01:20.576417 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:20.576395 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 23:01:20.576722 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:20.576447 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:28.576429931 +0000 UTC m=+273.068310169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : secret "insights-runtime-extractor-tls" not found Sep 07 23:01:20.672450 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:20.672407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:20.892193 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:20.892097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:21.076900 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:21.076862 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:21.276896 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:21.276859 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:22.091603 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:22.091567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:22.148452 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:22.148424 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:22.470384 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:22.470345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:22.669906 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:22.669867 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:22.771027 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:22.770948 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:22.875300 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:22.875263 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:23.072854 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:23.072762 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:23.492785 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:23.492747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:24.080846 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.080810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:24.205643 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.205600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:24.205825 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.205720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:24.205872 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:24.205849 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:24.205927 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:24.205917 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls podName:33c7561a-c7ee-4e37-836f-2b3623d89c25 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:40.205896926 +0000 UTC m=+284.697777157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-27pzn" (UID: "33c7561a-c7ee-4e37-836f-2b3623d89c25") : secret "cluster-monitoring-operator-tls" not found Sep 07 23:01:24.208006 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.207976 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls\") pod \"image-registry-64f97c8c4f-mj54p\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:24.275524 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.275486 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:24.306483 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.306441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:24.308791 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.308765 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc803d9b-8786-4ec9-a27d-63a93edd4c32-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lqmd7\" (UID: \"fc803d9b-8786-4ec9-a27d-63a93edd4c32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:24.378097 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.378011 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" Sep 07 23:01:24.482003 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.481966 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:24.548414 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.548380 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64f97c8c4f-mj54p"] Sep 07 23:01:24.551201 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:24.551177 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15cbec64_3e98_401e_952e_4bc3af67730d.slice/crio-eeb7e1e9eb89f3be06aa5d3dd2b81f5cdb3a8e1c716a501ac3e66cc52fb12b19 WatchSource:0}: Error finding container eeb7e1e9eb89f3be06aa5d3dd2b81f5cdb3a8e1c716a501ac3e66cc52fb12b19: Status 404 returned error can't find the container with id eeb7e1e9eb89f3be06aa5d3dd2b81f5cdb3a8e1c716a501ac3e66cc52fb12b19 Sep 07 23:01:24.646958 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.646883 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7"] Sep 07 23:01:24.751387 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.751349 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:24.851896 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.851859 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" event={"ID":"15cbec64-3e98-401e-952e-4bc3af67730d","Type":"ContainerStarted","Data":"34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a"} Sep 07 23:01:24.852100 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.851927 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" event={"ID":"15cbec64-3e98-401e-952e-4bc3af67730d","Type":"ContainerStarted","Data":"eeb7e1e9eb89f3be06aa5d3dd2b81f5cdb3a8e1c716a501ac3e66cc52fb12b19"} Sep 07 23:01:24.852100 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.851955 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:24.853089 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.853058 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" event={"ID":"fc803d9b-8786-4ec9-a27d-63a93edd4c32","Type":"ContainerStarted","Data":"1a1546375534634b2ebd40c95a0f2ee8f2d4213dba393feb2425dfff90bc4306"} Sep 07 23:01:24.874118 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:24.874068 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" podStartSLOduration=16.874052771 podStartE2EDuration="16.874052771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:24.872912365 +0000 UTC m=+269.364792624" watchObservedRunningTime="2026-09-07 23:01:24.874052771 +0000 UTC m=+269.365933018" Sep 07 23:01:25.058209 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:25.058171 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:25.113402 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:25.113349 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:25.681674 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:25.681631 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:26.030676 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:26.030589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:26.275766 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:26.275718 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:26.475703 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:26.475651 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:26.680841 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:26.680797 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:26.862125 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:26.862036 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" event={"ID":"fc803d9b-8786-4ec9-a27d-63a93edd4c32","Type":"ContainerStarted","Data":"e5d3142c19bc5a5c292a97286056a5d2de0aa78d2233c8fb2b415a55d12663a4"} Sep 07 23:01:26.862125 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:26.862088 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" event={"ID":"fc803d9b-8786-4ec9-a27d-63a93edd4c32","Type":"ContainerStarted","Data":"1861a72071b19b956c26447e32053426b3b216c1878aeb89cad85532fc312da7"} Sep 07 23:01:26.876958 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:26.876906 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lqmd7" podStartSLOduration=17.043644405 podStartE2EDuration="18.876890681s" totalImagesPullingTime="1.833246276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:26.875851964 +0000 UTC m=+271.367732212" watchObservedRunningTime="2026-09-07 23:01:26.876890681 +0000 UTC m=+271.368770967" Sep 07 23:01:27.076600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:27.076564 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:27.874748 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:27.874709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:28.079590 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:28.079549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:28.473776 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:28.473746 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:28.644822 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:28.644788 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:28.644971 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:28.644844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:28.644971 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:28.644952 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 23:01:28.645042 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:28.645017 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls podName:76ca2144-5f97-433b-a453-38003496f82a nodeName:}" failed. No retries permitted until 2026-09-07 23:01:44.644998972 +0000 UTC m=+289.136879198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcfdw" (UID: "76ca2144-5f97-433b-a453-38003496f82a") : secret "insights-runtime-extractor-tls" not found Sep 07 23:01:28.645304 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:28.645285 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76ca2144-5f97-433b-a453-38003496f82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:28.684578 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:28.684546 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:29.074603 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:29.074562 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:29.275017 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:29.274976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:35.610729 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:35.610680 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64f97c8c4f-mj54p"] Sep 07 23:01:35.747038 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:35.746997 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:35.849790 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:35.849753 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:35.949087 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:35.949052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:36.046384 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:36.046351 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:36.540231 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:36.540181 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tqhmh" podUID="dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb" Sep 07 23:01:36.897380 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:36.897302 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqhmh" Sep 07 23:01:39.066594 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:39.066559 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:39.119623 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:39.119588 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:40.236910 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.236842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:40.239252 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.239227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33c7561a-c7ee-4e37-836f-2b3623d89c25-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-27pzn\" (UID: \"33c7561a-c7ee-4e37-836f-2b3623d89c25\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:40.337610 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.337574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 23:01:40.339918 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.339886 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb-metrics-tls\") pod \"dns-default-tqhmh\" (UID: \"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb\") " pod="openshift-dns/dns-default-tqhmh" Sep 07 23:01:40.469672 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.469619 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" Sep 07 23:01:40.500146 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.500058 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nflgb\"" Sep 07 23:01:40.508188 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.508131 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqhmh" Sep 07 23:01:40.738306 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.738272 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn"] Sep 07 23:01:40.740991 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:40.740963 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c7561a_c7ee_4e37_836f_2b3623d89c25.slice/crio-0c3fe9e936a641dc85903b6d1103e1b4c6bccf663ef0bc531fc7782de9846bf4 WatchSource:0}: Error finding container 0c3fe9e936a641dc85903b6d1103e1b4c6bccf663ef0bc531fc7782de9846bf4: Status 404 returned error can't find the container with id 0c3fe9e936a641dc85903b6d1103e1b4c6bccf663ef0bc531fc7782de9846bf4 Sep 07 23:01:40.780398 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.780324 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tqhmh"] Sep 07 23:01:40.783005 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:40.782980 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddacb9145_5d8f_4fa5_8f7a_ac2ff0ca5bdb.slice/crio-556f4cc0e9c3ed5146105bba6e675030d0c5d11503f8f8be40e9d70395104947 WatchSource:0}: Error finding container 556f4cc0e9c3ed5146105bba6e675030d0c5d11503f8f8be40e9d70395104947: Status 404 returned error can't find the container with id 556f4cc0e9c3ed5146105bba6e675030d0c5d11503f8f8be40e9d70395104947 Sep 07 23:01:40.911314 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.911272 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" event={"ID":"33c7561a-c7ee-4e37-836f-2b3623d89c25","Type":"ContainerStarted","Data":"0c3fe9e936a641dc85903b6d1103e1b4c6bccf663ef0bc531fc7782de9846bf4"} Sep 07 23:01:40.912347 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:40.912311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqhmh" event={"ID":"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb","Type":"ContainerStarted","Data":"556f4cc0e9c3ed5146105bba6e675030d0c5d11503f8f8be40e9d70395104947"} Sep 07 23:01:42.925064 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:42.925028 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" event={"ID":"33c7561a-c7ee-4e37-836f-2b3623d89c25","Type":"ContainerStarted","Data":"27b552913bebfd7a5ade8bc7f800e80b35e6cc8292a9d1129b5dc6dc31aa5f1b"} Sep 07 23:01:42.927581 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:42.927538 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqhmh" event={"ID":"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb","Type":"ContainerStarted","Data":"5af2f9a7420c28a5271e1be10a57cea14cda69dd8ee1a4d72d30896a61d3427f"} Sep 07 23:01:42.941844 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:42.941275 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-27pzn" podStartSLOduration=32.849576012 podStartE2EDuration="34.94125835s" totalImagesPullingTime="2.091682338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:42.939738845 +0000 UTC m=+287.431619115" watchObservedRunningTime="2026-09-07 23:01:42.94125835 +0000 UTC m=+287.433138596" Sep 07 23:01:43.172102 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.172067 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:43.271949 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.271912 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:43.319674 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.319642 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4"] Sep 07 23:01:43.321532 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.321515 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" Sep 07 23:01:43.323735 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.323713 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 07 23:01:43.323850 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.323783 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7gqj4\"" Sep 07 23:01:43.331211 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.331187 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4"] Sep 07 23:01:43.338811 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.338779 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:43.462511 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.462408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d09e97fd-3d1c-4d35-b8f5-b8794f86430d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-hh4l4\" (UID: \"d09e97fd-3d1c-4d35-b8f5-b8794f86430d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" Sep 07 23:01:43.563487 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.563451 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d09e97fd-3d1c-4d35-b8f5-b8794f86430d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-hh4l4\" (UID: \"d09e97fd-3d1c-4d35-b8f5-b8794f86430d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" Sep 07 23:01:43.563639 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:43.563619 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 07 23:01:43.563725 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:43.563712 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d09e97fd-3d1c-4d35-b8f5-b8794f86430d-tls-certificates podName:d09e97fd-3d1c-4d35-b8f5-b8794f86430d nodeName:}" failed. No retries permitted until 2026-09-07 23:01:44.063680365 +0000 UTC m=+288.555560597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d09e97fd-3d1c-4d35-b8f5-b8794f86430d-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-hh4l4" (UID: "d09e97fd-3d1c-4d35-b8f5-b8794f86430d") : secret "prometheus-operator-admission-webhook-tls" not found Sep 07 23:01:43.665971 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.665933 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:43.932579 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.932547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqhmh" event={"ID":"dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb","Type":"ContainerStarted","Data":"37ccff76ef59ea06b5386d956c9a379432acd52db293dc4f5a045275ac831e4b"} Sep 07 23:01:43.948046 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:43.947996 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tqhmh" podStartSLOduration=251.89636724 podStartE2EDuration="4m13.947980164s" totalImagesPullingTime="2.051612924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:43.947666983 +0000 UTC m=+288.439547223" watchObservedRunningTime="2026-09-07 23:01:43.947980164 +0000 UTC m=+288.439860411" Sep 07 23:01:44.067860 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:44.067816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d09e97fd-3d1c-4d35-b8f5-b8794f86430d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-hh4l4\" (UID: \"d09e97fd-3d1c-4d35-b8f5-b8794f86430d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" Sep 07 23:01:44.070488 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:44.070463 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d09e97fd-3d1c-4d35-b8f5-b8794f86430d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-hh4l4\" (UID: \"d09e97fd-3d1c-4d35-b8f5-b8794f86430d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" Sep 07 23:01:44.230956 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:44.230866 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" Sep 07 23:01:44.501109 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:44.501033 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4"] Sep 07 23:01:44.503858 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:44.503829 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09e97fd_3d1c_4d35_b8f5_b8794f86430d.slice/crio-f2d5304922c6ae9e36f6de29013bde1a2959215032fda21db45fceef1660aa6a WatchSource:0}: Error finding container f2d5304922c6ae9e36f6de29013bde1a2959215032fda21db45fceef1660aa6a: Status 404 returned error can't find the container with id f2d5304922c6ae9e36f6de29013bde1a2959215032fda21db45fceef1660aa6a Sep 07 23:01:44.672813 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:44.672772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:44.675105 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:44.675085 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76ca2144-5f97-433b-a453-38003496f82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcfdw\" (UID: \"76ca2144-5f97-433b-a453-38003496f82a\") " pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:44.900579 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:44.900550 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mcfdw" Sep 07 23:01:44.937665 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:44.937628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" event={"ID":"d09e97fd-3d1c-4d35-b8f5-b8794f86430d","Type":"ContainerStarted","Data":"f2d5304922c6ae9e36f6de29013bde1a2959215032fda21db45fceef1660aa6a"} Sep 07 23:01:44.938023 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:44.937846 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tqhmh" Sep 07 23:01:45.173983 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:45.173899 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mcfdw"] Sep 07 23:01:45.177334 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:45.177303 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ca2144_5f97_433b_a453_38003496f82a.slice/crio-e08fe6ab3cd3518140c30a0b1d6f4852b0574a569cfdc23f2b8270134f26f056 WatchSource:0}: Error finding container e08fe6ab3cd3518140c30a0b1d6f4852b0574a569cfdc23f2b8270134f26f056: Status 404 returned error can't find the container with id e08fe6ab3cd3518140c30a0b1d6f4852b0574a569cfdc23f2b8270134f26f056 Sep 07 23:01:45.617341 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:45.617306 2575 patch_prober.go:28] interesting pod/image-registry-64f97c8c4f-mj54p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 07 23:01:45.617495 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:45.617364 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" podUID="15cbec64-3e98-401e-952e-4bc3af67730d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 07 23:01:45.942321 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:45.942271 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" event={"ID":"d09e97fd-3d1c-4d35-b8f5-b8794f86430d","Type":"ContainerStarted","Data":"8682f2a962609ee77ccad87859797ffa0c5b7d81e278234cfa93f62860f07e42"} Sep 07 23:01:45.942775 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:45.942336 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" Sep 07 23:01:45.944310 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:45.944261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcfdw" event={"ID":"76ca2144-5f97-433b-a453-38003496f82a","Type":"ContainerStarted","Data":"07027f0735302910acff8bf8ef9e388fb61d71e436577061b048b9e6e52e6424"} Sep 07 23:01:45.944310 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:45.944312 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcfdw" event={"ID":"76ca2144-5f97-433b-a453-38003496f82a","Type":"ContainerStarted","Data":"9e2c68aa1e5fa11e05b68c0b6123bf67ce0dd7902f5d7c842fcbe357da93591b"} Sep 07 23:01:45.944480 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:45.944331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcfdw" event={"ID":"76ca2144-5f97-433b-a453-38003496f82a","Type":"ContainerStarted","Data":"e08fe6ab3cd3518140c30a0b1d6f4852b0574a569cfdc23f2b8270134f26f056"} Sep 07 23:01:45.947747 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:45.947725 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" Sep 07 23:01:45.956219 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:45.956179 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hh4l4" podStartSLOduration=1.916306084 podStartE2EDuration="2.95616326s" totalImagesPullingTime="1.039857176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:45.955159744 +0000 UTC m=+290.447039990" watchObservedRunningTime="2026-09-07 23:01:45.95616326 +0000 UTC m=+290.448043527" Sep 07 23:01:46.351880 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:46.351836 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:46.404981 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:46.404946 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:46.701666 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:46.701611 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:47.954136 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:47.954094 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcfdw" event={"ID":"76ca2144-5f97-433b-a453-38003496f82a","Type":"ContainerStarted","Data":"d5e19bd0c72035d30e981da3c5d615f22977e4f855f0028d6d0f129e3858c754"} Sep 07 23:01:47.971983 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:47.971928 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mcfdw" podStartSLOduration=33.777507852 podStartE2EDuration="35.971912561s" totalImagesPullingTime="2.194404709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 23:01:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:47.970616194 +0000 UTC m=+292.462496442" watchObservedRunningTime="2026-09-07 23:01:47.971912561 +0000 UTC m=+292.463792807" Sep 07 23:01:49.469966 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:49.469925 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:49.927544 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:49.927502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:49.983322 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:49.983281 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:51.464292 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.464253 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:51.688038 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.688001 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j"] Sep 07 23:01:51.691298 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.691277 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.697805 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.697783 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 07 23:01:51.698009 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.697793 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 07 23:01:51.698375 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.697806 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 23:01:51.698375 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.697847 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wp2dc\"" Sep 07 23:01:51.704273 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.704246 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j"] Sep 07 23:01:51.709555 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.709534 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mqmlh"] Sep 07 23:01:51.713048 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.713027 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh"] Sep 07 23:01:51.713186 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.713168 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.716451 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.715396 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-876zr\"" Sep 07 23:01:51.716451 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.715603 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 23:01:51.716451 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.715823 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 23:01:51.716451 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.716062 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 23:01:51.716715 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.716537 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.718779 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.718764 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 07 23:01:51.718987 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.718867 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 07 23:01:51.719140 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.718931 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-s7qgl\"" Sep 07 23:01:51.719259 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.718937 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 07 23:01:51.726324 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.726305 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh"] Sep 07 23:01:51.726725 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.726679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eeba437e-e242-4872-9520-477ba14443b6-root\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.726819 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.726781 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eeba437e-e242-4872-9520-477ba14443b6-sys\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.726876 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.726818 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1df7ee00-4b40-41eb-b96d-43677ed257c9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.726876 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.726864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-tls\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.726985 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.726888 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-wtmp\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.726985 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.726916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1df7ee00-4b40-41eb-b96d-43677ed257c9-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.726985 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.726968 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.727703 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r55bk\" (UniqueName: \"kubernetes.io/projected/62884f84-f367-413d-a549-55419cb24d1e-kube-api-access-r55bk\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.727802 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr5hl\" (UniqueName: \"kubernetes.io/projected/eeba437e-e242-4872-9520-477ba14443b6-kube-api-access-dr5hl\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.727802 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1df7ee00-4b40-41eb-b96d-43677ed257c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.727802 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727772 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.727802 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-textfile\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.728011 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdsxg\" (UniqueName: \"kubernetes.io/projected/1df7ee00-4b40-41eb-b96d-43677ed257c9-kube-api-access-tdsxg\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.728011 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.728011 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62884f84-f367-413d-a549-55419cb24d1e-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.728011 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727894 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeba437e-e242-4872-9520-477ba14443b6-metrics-client-ca\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.728011 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727915 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.728011 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62884f84-f367-413d-a549-55419cb24d1e-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.728011 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.727970 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.829020 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.828979 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.829204 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r55bk\" (UniqueName: \"kubernetes.io/projected/62884f84-f367-413d-a549-55419cb24d1e-kube-api-access-r55bk\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.829204 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr5hl\" (UniqueName: \"kubernetes.io/projected/eeba437e-e242-4872-9520-477ba14443b6-kube-api-access-dr5hl\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.829204 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1df7ee00-4b40-41eb-b96d-43677ed257c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.829204 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.829204 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829153 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-textfile\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.829204 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdsxg\" (UniqueName: \"kubernetes.io/projected/1df7ee00-4b40-41eb-b96d-43677ed257c9-kube-api-access-tdsxg\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.829509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.829509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62884f84-f367-413d-a549-55419cb24d1e-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.829509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829261 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeba437e-e242-4872-9520-477ba14443b6-metrics-client-ca\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.829509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829285 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.829509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829314 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62884f84-f367-413d-a549-55419cb24d1e-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.829509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829343 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.829509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eeba437e-e242-4872-9520-477ba14443b6-root\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.829509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829423 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eeba437e-e242-4872-9520-477ba14443b6-sys\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.829509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1df7ee00-4b40-41eb-b96d-43677ed257c9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.829509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829496 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-tls\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.830014 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829518 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-wtmp\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.830014 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1df7ee00-4b40-41eb-b96d-43677ed257c9-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.830014 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.829566 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eeba437e-e242-4872-9520-477ba14443b6-root\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.830318 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.830296 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1df7ee00-4b40-41eb-b96d-43677ed257c9-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.830410 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.830321 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.830410 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:51.830399 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 07 23:01:51.830525 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:51.830414 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 07 23:01:51.830525 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:51.830452 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-tls podName:eeba437e-e242-4872-9520-477ba14443b6 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:52.330435508 +0000 UTC m=+296.822315748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-tls") pod "node-exporter-mqmlh" (UID: "eeba437e-e242-4872-9520-477ba14443b6") : secret "node-exporter-tls" not found Sep 07 23:01:51.830525 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:51.830468 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df7ee00-4b40-41eb-b96d-43677ed257c9-openshift-state-metrics-tls podName:1df7ee00-4b40-41eb-b96d-43677ed257c9 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:52.330459369 +0000 UTC m=+296.822339597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1df7ee00-4b40-41eb-b96d-43677ed257c9-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-qk96j" (UID: "1df7ee00-4b40-41eb-b96d-43677ed257c9") : secret "openshift-state-metrics-tls" not found Sep 07 23:01:51.830675 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.830580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-wtmp\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.831224 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:51.831029 2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 07 23:01:51.831224 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:51.831074 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-tls podName:62884f84-f367-413d-a549-55419cb24d1e nodeName:}" failed. No retries permitted until 2026-09-07 23:01:52.331059687 +0000 UTC m=+296.822939916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-pmvhh" (UID: "62884f84-f367-413d-a549-55419cb24d1e") : secret "kube-state-metrics-tls" not found Sep 07 23:01:51.837146 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.836526 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62884f84-f367-413d-a549-55419cb24d1e-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.837146 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.836946 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.839643 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.838068 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62884f84-f367-413d-a549-55419cb24d1e-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.839643 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.838446 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1df7ee00-4b40-41eb-b96d-43677ed257c9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.839643 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.838523 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eeba437e-e242-4872-9520-477ba14443b6-sys\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.839643 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.838903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeba437e-e242-4872-9520-477ba14443b6-metrics-client-ca\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.839643 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.839147 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:51.839643 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.839418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-textfile\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.851196 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.848276 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr5hl\" (UniqueName: \"kubernetes.io/projected/eeba437e-e242-4872-9520-477ba14443b6-kube-api-access-dr5hl\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.851196 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.849596 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdsxg\" (UniqueName: \"kubernetes.io/projected/1df7ee00-4b40-41eb-b96d-43677ed257c9-kube-api-access-tdsxg\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:51.851801 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.851562 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:51.853383 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:51.853347 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r55bk\" (UniqueName: \"kubernetes.io/projected/62884f84-f367-413d-a549-55419cb24d1e-kube-api-access-r55bk\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:52.027021 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:52.026930 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-drkv2" podUID="25fa86da-a99d-4924-9a7a-7cb993ac385c" Sep 07 23:01:52.333962 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.333870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:52.334107 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:52.334024 2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 07 23:01:52.334107 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.334063 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-tls\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:52.334107 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:52.334088 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-tls podName:62884f84-f367-413d-a549-55419cb24d1e nodeName:}" failed. No retries permitted until 2026-09-07 23:01:53.334072249 +0000 UTC m=+297.825952474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-pmvhh" (UID: "62884f84-f367-413d-a549-55419cb24d1e") : secret "kube-state-metrics-tls" not found Sep 07 23:01:52.334228 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.334136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1df7ee00-4b40-41eb-b96d-43677ed257c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:52.336377 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.336353 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1df7ee00-4b40-41eb-b96d-43677ed257c9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qk96j\" (UID: \"1df7ee00-4b40-41eb-b96d-43677ed257c9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:52.336480 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.336411 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eeba437e-e242-4872-9520-477ba14443b6-node-exporter-tls\") pod \"node-exporter-mqmlh\" (UID: \"eeba437e-e242-4872-9520-477ba14443b6\") " pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:52.603236 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.603147 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" Sep 07 23:01:52.628496 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.628466 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mqmlh" Sep 07 23:01:52.844704 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.844651 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:52.884003 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.883909 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j"] Sep 07 23:01:52.975393 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.975342 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" event={"ID":"1df7ee00-4b40-41eb-b96d-43677ed257c9","Type":"ContainerStarted","Data":"8b89ded155d6efc9a86e2c8a2189f2a3fc361e2052de8483b23b0ddc916006c2"} Sep 07 23:01:52.975569 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.975441 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" event={"ID":"1df7ee00-4b40-41eb-b96d-43677ed257c9","Type":"ContainerStarted","Data":"a30fbf18768942a1aea33ed060fab01771832cbff4d62f3378ee4a984e531290"} Sep 07 23:01:52.976777 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:52.976754 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mqmlh" event={"ID":"eeba437e-e242-4872-9520-477ba14443b6","Type":"ContainerStarted","Data":"89aa09aaff089be89ebb13653d42ac34c7b7dbca2e0779516a12fa39e73bdefd"} Sep 07 23:01:53.162147 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:53.162116 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:53.342278 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:53.342238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:53.345243 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:53.345217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62884f84-f367-413d-a549-55419cb24d1e-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pmvhh\" (UID: \"62884f84-f367-413d-a549-55419cb24d1e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:53.534816 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:53.534722 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" Sep 07 23:01:53.889306 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:53.889268 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh"] Sep 07 23:01:53.892086 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:53.892056 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62884f84_f367_413d_a549_55419cb24d1e.slice/crio-fc43f1e747a05eabf549c03635b67a35df6e0bc1e2dfe0c1df30a44f244519a9 WatchSource:0}: Error finding container fc43f1e747a05eabf549c03635b67a35df6e0bc1e2dfe0c1df30a44f244519a9: Status 404 returned error can't find the container with id fc43f1e747a05eabf549c03635b67a35df6e0bc1e2dfe0c1df30a44f244519a9 Sep 07 23:01:53.983865 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:53.983826 2575 generic.go:356] "Generic (PLEG): container finished" podID="eeba437e-e242-4872-9520-477ba14443b6" containerID="9fb92b7daa458218319857ed779e940ac0755829151efb1fd1da2685cfaeac2b" exitCode=0 Sep 07 23:01:53.984045 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:53.983904 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mqmlh" event={"ID":"eeba437e-e242-4872-9520-477ba14443b6","Type":"ContainerDied","Data":"9fb92b7daa458218319857ed779e940ac0755829151efb1fd1da2685cfaeac2b"} Sep 07 23:01:53.986315 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:53.986285 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" event={"ID":"1df7ee00-4b40-41eb-b96d-43677ed257c9","Type":"ContainerStarted","Data":"afdad03a296a83d92490ab8487ae5491ad9aad2ca672345afeac40662915fb10"} Sep 07 23:01:53.987626 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:53.987602 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" event={"ID":"62884f84-f367-413d-a549-55419cb24d1e","Type":"ContainerStarted","Data":"fc43f1e747a05eabf549c03635b67a35df6e0bc1e2dfe0c1df30a44f244519a9"} Sep 07 23:01:54.628251 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:54.628000 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:54.731667 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:54.731591 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:54.907068 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:54.906972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:54.947550 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:54.947520 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tqhmh" Sep 07 23:01:54.996939 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:54.996889 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mqmlh" event={"ID":"eeba437e-e242-4872-9520-477ba14443b6","Type":"ContainerStarted","Data":"5c55b9610f43314f17fae690d4288cc1a1a6e3ed1ead485afec411ad6cc9caff"} Sep 07 23:01:54.997118 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:54.996973 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mqmlh" event={"ID":"eeba437e-e242-4872-9520-477ba14443b6","Type":"ContainerStarted","Data":"e571cc39bc90456b2b2175602b8f92ed4e1132c2d2b87c072f0c6fa13ef5c1a1"} Sep 07 23:01:55.001531 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:55.001183 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" event={"ID":"1df7ee00-4b40-41eb-b96d-43677ed257c9","Type":"ContainerStarted","Data":"c88bdd91f9dee4e83f5ac612146ed219c94ab95cdff5ee3c74f369706d2d56c3"} Sep 07 23:01:55.007098 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:55.007052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:55.016448 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:55.015753 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mqmlh" podStartSLOduration=2.925113614 podStartE2EDuration="4.015731101s" totalImagesPullingTime="1.024272735s" totalInitContainerRuntime="66.344752ms" isStatefulPod=true podCreationTimestamp="2026-09-07 23:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:55.014785464 +0000 UTC m=+299.506665759" watchObservedRunningTime="2026-09-07 23:01:55.015731101 +0000 UTC m=+299.507611356" Sep 07 23:01:55.035313 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:55.035253 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qk96j" podStartSLOduration=2.676993287 podStartE2EDuration="4.035230019s" totalImagesPullingTime="1.358236732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:55.034149212 +0000 UTC m=+299.526029483" watchObservedRunningTime="2026-09-07 23:01:55.035230019 +0000 UTC m=+299.527110266" Sep 07 23:01:55.107360 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:55.107312 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:55.464295 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:55.464259 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:55.615599 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:55.615523 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:01:55.955279 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:55.955255 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:01:55.955715 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:55.955448 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:01:55.958310 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:55.958293 2575 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 23:01:56.007510 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.007339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" event={"ID":"62884f84-f367-413d-a549-55419cb24d1e","Type":"ContainerStarted","Data":"366591af240a30b0ecf730aa72f2c9014c8d925f6756d68b766b3bc0dda0fd71"} Sep 07 23:01:56.007510 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.007410 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" event={"ID":"62884f84-f367-413d-a549-55419cb24d1e","Type":"ContainerStarted","Data":"995350f972db63f6a91b1db6c35b7546a4ed8b3460c76451c584b36ee3794be3"} Sep 07 23:01:56.007510 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.007434 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" event={"ID":"62884f84-f367-413d-a549-55419cb24d1e","Type":"ContainerStarted","Data":"0595ab9af69bb5c7fa7cbfda1368f4b36a3df42965313ec7c0ee4f849137c550"} Sep 07 23:01:56.025801 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.025747 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pmvhh" podStartSLOduration=3.609381336 podStartE2EDuration="5.025725483s" totalImagesPullingTime="1.416344147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:56.024125432 +0000 UTC m=+300.516005693" watchObservedRunningTime="2026-09-07 23:01:56.025725483 +0000 UTC m=+300.517605731" Sep 07 23:01:56.491732 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.491672 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd"] Sep 07 23:01:56.494903 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.494883 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:01:56.497780 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.497757 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 07 23:01:56.497885 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.497780 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-f2mp9\"" Sep 07 23:01:56.516980 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.516953 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd"] Sep 07 23:01:56.538738 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.538697 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:56.572498 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.572454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkwsg\" (UniqueName: \"kubernetes.io/projected/75fd45f0-6414-4af6-bf40-062005dbbdfc-kube-api-access-dkwsg\") pod \"monitoring-plugin-85bbbbbf4-cpcnd\" (UID: \"75fd45f0-6414-4af6-bf40-062005dbbdfc\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:01:56.572656 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.572518 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75fd45f0-6414-4af6-bf40-062005dbbdfc-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cpcnd\" (UID: \"75fd45f0-6414-4af6-bf40-062005dbbdfc\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:01:56.673958 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.673922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkwsg\" (UniqueName: \"kubernetes.io/projected/75fd45f0-6414-4af6-bf40-062005dbbdfc-kube-api-access-dkwsg\") pod \"monitoring-plugin-85bbbbbf4-cpcnd\" (UID: \"75fd45f0-6414-4af6-bf40-062005dbbdfc\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:01:56.674160 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.673977 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75fd45f0-6414-4af6-bf40-062005dbbdfc-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cpcnd\" (UID: \"75fd45f0-6414-4af6-bf40-062005dbbdfc\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:01:56.674160 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:56.674139 2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 07 23:01:56.674278 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:01:56.674216 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75fd45f0-6414-4af6-bf40-062005dbbdfc-monitoring-plugin-cert podName:75fd45f0-6414-4af6-bf40-062005dbbdfc nodeName:}" failed. No retries permitted until 2026-09-07 23:01:57.174193521 +0000 UTC m=+301.666073763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/75fd45f0-6414-4af6-bf40-062005dbbdfc-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-cpcnd" (UID: "75fd45f0-6414-4af6-bf40-062005dbbdfc") : secret "monitoring-plugin-cert" not found Sep 07 23:01:56.684206 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.684174 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkwsg\" (UniqueName: \"kubernetes.io/projected/75fd45f0-6414-4af6-bf40-062005dbbdfc-kube-api-access-dkwsg\") pod \"monitoring-plugin-85bbbbbf4-cpcnd\" (UID: \"75fd45f0-6414-4af6-bf40-062005dbbdfc\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:01:56.814915 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.814828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:56.888284 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.888246 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-764547cb79-vkhr6"] Sep 07 23:01:56.891625 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.891603 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:56.893923 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.893895 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 07 23:01:56.894039 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.893930 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 07 23:01:56.894098 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.894067 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 07 23:01:56.894098 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.894079 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qzgfr\"" Sep 07 23:01:56.894205 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.894068 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 07 23:01:56.894205 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.894067 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 07 23:01:56.898983 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.898961 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 07 23:01:56.905621 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.905591 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-764547cb79-vkhr6"] Sep 07 23:01:56.976784 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.976744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-secret-telemeter-client\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:56.976784 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.976784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-telemeter-trusted-ca-bundle\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:56.977309 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.976804 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:56.977309 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.976882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-telemeter-client-tls\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:56.977309 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.976961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-metrics-client-ca\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:56.977309 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.977020 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zxns\" (UniqueName: \"kubernetes.io/projected/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-kube-api-access-9zxns\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:56.977309 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.977059 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-federate-client-tls\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:56.977309 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:56.977099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-serving-certs-ca-bundle\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.078036 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.077932 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-secret-telemeter-client\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.078036 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.077993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-telemeter-trusted-ca-bundle\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.078036 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.078026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.078280 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.078063 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-telemeter-client-tls\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.078280 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.078199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-metrics-client-ca\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.078280 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.078272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxns\" (UniqueName: \"kubernetes.io/projected/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-kube-api-access-9zxns\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.078562 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.078539 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-federate-client-tls\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.078806 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.078786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-serving-certs-ca-bundle\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.079033 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.078995 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-metrics-client-ca\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.079122 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.079060 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-telemeter-trusted-ca-bundle\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.079653 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.079600 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-serving-certs-ca-bundle\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.080791 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.080767 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.081099 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.081082 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-secret-telemeter-client\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.081176 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.081152 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-federate-client-tls\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.081229 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.081149 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-telemeter-client-tls\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.085333 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.085311 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zxns\" (UniqueName: \"kubernetes.io/projected/e741e6b2-37ce-48c8-9ade-cbb8887b3f50-kube-api-access-9zxns\") pod \"telemeter-client-764547cb79-vkhr6\" (UID: \"e741e6b2-37ce-48c8-9ade-cbb8887b3f50\") " pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.180115 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.180075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75fd45f0-6414-4af6-bf40-062005dbbdfc-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cpcnd\" (UID: \"75fd45f0-6414-4af6-bf40-062005dbbdfc\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:01:57.182428 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.182404 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75fd45f0-6414-4af6-bf40-062005dbbdfc-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cpcnd\" (UID: \"75fd45f0-6414-4af6-bf40-062005dbbdfc\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:01:57.201200 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.201166 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" Sep 07 23:01:57.404167 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.404134 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:01:57.479370 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.479329 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-764547cb79-vkhr6"] Sep 07 23:01:57.482669 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:57.482640 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode741e6b2_37ce_48c8_9ade_cbb8887b3f50.slice/crio-947c4f9440a10ae1d4b2249a7f03fd874cc532eb19af3607725edcedbfa6599a WatchSource:0}: Error finding container 947c4f9440a10ae1d4b2249a7f03fd874cc532eb19af3607725edcedbfa6599a: Status 404 returned error can't find the container with id 947c4f9440a10ae1d4b2249a7f03fd874cc532eb19af3607725edcedbfa6599a Sep 07 23:01:57.484823 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.484805 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 23:01:57.673581 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.673503 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd"] Sep 07 23:01:57.676768 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:57.676733 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75fd45f0_6414_4af6_bf40_062005dbbdfc.slice/crio-f388aec02c805624959b9b93a5ef1f4ca5237e9dec968dcf475e45e33bf708ed WatchSource:0}: Error finding container f388aec02c805624959b9b93a5ef1f4ca5237e9dec968dcf475e45e33bf708ed: Status 404 returned error can't find the container with id f388aec02c805624959b9b93a5ef1f4ca5237e9dec968dcf475e45e33bf708ed Sep 07 23:01:57.772949 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.772913 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:57.873518 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.873476 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:57.955323 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.955233 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 23:01:57.957005 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.956974 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:57.960731 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.960710 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:57.963292 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.963138 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 23:01:57.963292 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.963142 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 23:01:57.963292 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.963190 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 23:01:57.963292 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.963169 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 23:01:57.963555 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.963418 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 23:01:57.963709 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.963681 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 23:01:57.963994 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.963978 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 23:01:57.964411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.964386 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n898t\"" Sep 07 23:01:57.964632 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.964611 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9mj7jje8e3fc7\"" Sep 07 23:01:57.964632 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.964625 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 23:01:57.964820 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.964639 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 23:01:57.964820 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.964655 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 23:01:57.964981 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.964960 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 23:01:57.965037 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.964992 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 23:01:57.965177 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.965158 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 23:01:57.967196 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.967174 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 23:01:57.970129 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.970110 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 23:01:57.975739 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:57.975712 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 23:01:58.015526 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.015487 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" event={"ID":"e741e6b2-37ce-48c8-9ade-cbb8887b3f50","Type":"ContainerStarted","Data":"947c4f9440a10ae1d4b2249a7f03fd874cc532eb19af3607725edcedbfa6599a"} Sep 07 23:01:58.016637 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.016606 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" event={"ID":"75fd45f0-6414-4af6-bf40-062005dbbdfc","Type":"ContainerStarted","Data":"f388aec02c805624959b9b93a5ef1f4ca5237e9dec968dcf475e45e33bf708ed"} Sep 07 23:01:58.079046 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.078998 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:58.087169 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087288 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087288 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087216 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087288 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087232 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087288 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087427 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087427 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52v4f\" (UniqueName: \"kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-kube-api-access-52v4f\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087427 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087377 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087427 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087392 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087547 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087547 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087547 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087492 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087547 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087547 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087537 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087721 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087721 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087721 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087721 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087721 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.087721 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.087659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.188939 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.188858 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.188939 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.188912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189172 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.188951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189172 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.188969 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189172 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.188989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189172 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189172 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189468 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189554 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189469 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189554 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189498 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189554 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189638 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.189804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189798 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52v4f\" (UniqueName: \"kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-kube-api-access-52v4f\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.190253 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189826 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.190253 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.190253 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189914 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.190253 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.189953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.190857 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.190749 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.192393 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.192290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.192570 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.192463 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.193744 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.192876 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.193744 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.193343 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.193744 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.193394 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.193744 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.193657 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.194980 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.194212 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.194980 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.194866 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.194980 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.194917 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.195462 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.195414 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.195795 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.195735 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.196261 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.196239 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.196632 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.196574 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.197233 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.197213 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.197624 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.197565 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.197715 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.197665 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.200551 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.200527 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52v4f\" (UniqueName: \"kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-kube-api-access-52v4f\") pod \"prometheus-k8s-0\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.271710 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.271591 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:01:58.567811 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.567728 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 23:01:58.571328 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:01:58.571298 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6e7a9a_b7ea_4982_9d44_0c7f1877e712.slice/crio-71717da8ac2d749dc7306b2437e0712f6b96835bcfff6f42ddebf4d5e17100e0 WatchSource:0}: Error finding container 71717da8ac2d749dc7306b2437e0712f6b96835bcfff6f42ddebf4d5e17100e0: Status 404 returned error can't find the container with id 71717da8ac2d749dc7306b2437e0712f6b96835bcfff6f42ddebf4d5e17100e0 Sep 07 23:01:58.993937 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:58.993901 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:01:59.022025 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:59.021973 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerStarted","Data":"71717da8ac2d749dc7306b2437e0712f6b96835bcfff6f42ddebf4d5e17100e0"} Sep 07 23:01:59.041755 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:01:59.041703 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:00.031946 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.031850 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" event={"ID":"75fd45f0-6414-4af6-bf40-062005dbbdfc","Type":"ContainerStarted","Data":"2309f549f7d586f0ea68e1a8860cdd2164069a35df99070ab422664223ed62e8"} Sep 07 23:02:00.031946 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.031907 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" event={"ID":"e741e6b2-37ce-48c8-9ade-cbb8887b3f50","Type":"ContainerStarted","Data":"90330fee575a51bd1311b0fee6c13820b4bce369e49f9f5370325376790902bf"} Sep 07 23:02:00.032408 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.031948 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:02:00.035209 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.035180 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" Sep 07 23:02:00.044257 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.044203 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cpcnd" podStartSLOduration=1.98781044 podStartE2EDuration="4.044185211s" totalImagesPullingTime="2.056374771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:02:00.042414888 +0000 UTC m=+304.534295140" watchObservedRunningTime="2026-09-07 23:02:00.044185211 +0000 UTC m=+304.536065462" Sep 07 23:02:00.630258 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.630141 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" podUID="15cbec64-3e98-401e-952e-4bc3af67730d" containerName="registry" containerID="cri-o://34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a" gracePeriod=30 Sep 07 23:02:00.873279 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.873254 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:02:00.917520 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.917493 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls\") pod \"15cbec64-3e98-401e-952e-4bc3af67730d\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " Sep 07 23:02:00.917704 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.917539 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-registry-certificates\") pod \"15cbec64-3e98-401e-952e-4bc3af67730d\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " Sep 07 23:02:00.917704 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.917557 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-bound-sa-token\") pod \"15cbec64-3e98-401e-952e-4bc3af67730d\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " Sep 07 23:02:00.917704 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.917586 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-image-registry-private-configuration\") pod \"15cbec64-3e98-401e-952e-4bc3af67730d\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " Sep 07 23:02:00.917704 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.917617 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/15cbec64-3e98-401e-952e-4bc3af67730d-ca-trust-extracted\") pod \"15cbec64-3e98-401e-952e-4bc3af67730d\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " Sep 07 23:02:00.917704 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.917646 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-installation-pull-secrets\") pod \"15cbec64-3e98-401e-952e-4bc3af67730d\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " Sep 07 23:02:00.917704 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.917674 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znj7s\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-kube-api-access-znj7s\") pod \"15cbec64-3e98-401e-952e-4bc3af67730d\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " Sep 07 23:02:00.918028 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.917728 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-trusted-ca\") pod \"15cbec64-3e98-401e-952e-4bc3af67730d\" (UID: \"15cbec64-3e98-401e-952e-4bc3af67730d\") " Sep 07 23:02:00.918245 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.918208 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "15cbec64-3e98-401e-952e-4bc3af67730d" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 23:02:00.918320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.918287 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "15cbec64-3e98-401e-952e-4bc3af67730d" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 23:02:00.919932 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.919897 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "15cbec64-3e98-401e-952e-4bc3af67730d" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:02:00.920232 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.920123 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "15cbec64-3e98-401e-952e-4bc3af67730d" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:02:00.920232 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.920202 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "15cbec64-3e98-401e-952e-4bc3af67730d" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 23:02:00.920337 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.920240 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "15cbec64-3e98-401e-952e-4bc3af67730d" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 23:02:00.920441 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.920423 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-kube-api-access-znj7s" (OuterVolumeSpecName: "kube-api-access-znj7s") pod "15cbec64-3e98-401e-952e-4bc3af67730d" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d"). InnerVolumeSpecName "kube-api-access-znj7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 23:02:00.928649 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:00.928622 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15cbec64-3e98-401e-952e-4bc3af67730d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "15cbec64-3e98-401e-952e-4bc3af67730d" (UID: "15cbec64-3e98-401e-952e-4bc3af67730d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 23:02:01.019306 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.019266 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/15cbec64-3e98-401e-952e-4bc3af67730d-ca-trust-extracted\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:02:01.019306 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.019297 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-installation-pull-secrets\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:02:01.019306 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.019307 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znj7s\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-kube-api-access-znj7s\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:02:01.019306 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.019316 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-trusted-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:02:01.019562 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.019327 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-registry-tls\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:02:01.019562 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.019335 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/15cbec64-3e98-401e-952e-4bc3af67730d-registry-certificates\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:02:01.019562 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.019344 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15cbec64-3e98-401e-952e-4bc3af67730d-bound-sa-token\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:02:01.019562 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.019360 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/15cbec64-3e98-401e-952e-4bc3af67730d-image-registry-private-configuration\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:02:01.037496 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.037464 2575 generic.go:356] "Generic (PLEG): container finished" podID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerID="dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53" exitCode=0 Sep 07 23:02:01.037922 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.037536 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerDied","Data":"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53"} Sep 07 23:02:01.038994 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.038970 2575 generic.go:356] "Generic (PLEG): container finished" podID="15cbec64-3e98-401e-952e-4bc3af67730d" containerID="34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a" exitCode=0 Sep 07 23:02:01.039091 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.039006 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" Sep 07 23:02:01.039091 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.039042 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" event={"ID":"15cbec64-3e98-401e-952e-4bc3af67730d","Type":"ContainerDied","Data":"34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a"} Sep 07 23:02:01.039091 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.039084 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f97c8c4f-mj54p" event={"ID":"15cbec64-3e98-401e-952e-4bc3af67730d","Type":"ContainerDied","Data":"eeb7e1e9eb89f3be06aa5d3dd2b81f5cdb3a8e1c716a501ac3e66cc52fb12b19"} Sep 07 23:02:01.039226 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.039110 2575 scope.go:117] "RemoveContainer" containerID="34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a" Sep 07 23:02:01.041585 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.041563 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" event={"ID":"e741e6b2-37ce-48c8-9ade-cbb8887b3f50","Type":"ContainerStarted","Data":"31c2899e073a6eafa3bbb7f5a670e8dfb6d8d5590f2ac2793af86f52c8ce4176"} Sep 07 23:02:01.041660 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.041613 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" event={"ID":"e741e6b2-37ce-48c8-9ade-cbb8887b3f50","Type":"ContainerStarted","Data":"603f953a57f2e4f2600f8e4e5c52ed1fc53fb30c283d773a16155cad88e0b600"} Sep 07 23:02:01.050156 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.050139 2575 scope.go:117] "RemoveContainer" containerID="34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a" Sep 07 23:02:01.050412 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:02:01.050393 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a\": container with ID starting with 34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a not found: ID does not exist" containerID="34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a" Sep 07 23:02:01.050453 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.050420 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a"} err="failed to get container status \"34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a\": rpc error: code = NotFound desc = could not find container \"34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a\": container with ID starting with 34c93bb28f73bd9e6284ba31e4c3172c3706008f32403d5114c8dac85d39703a not found: ID does not exist" Sep 07 23:02:01.087232 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.087175 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-764547cb79-vkhr6" podStartSLOduration=2.2782139 podStartE2EDuration="5.087157471s" totalImagesPullingTime="2.808943571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:02:01.084637272 +0000 UTC m=+305.576517519" watchObservedRunningTime="2026-09-07 23:02:01.087157471 +0000 UTC m=+305.579037717" Sep 07 23:02:01.099310 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.099273 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64f97c8c4f-mj54p"] Sep 07 23:02:01.105680 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.105651 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64f97c8c4f-mj54p"] Sep 07 23:02:01.322768 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.322658 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:01.434199 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.434162 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:01.553743 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:01.553674 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:02.032007 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:02.031968 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15cbec64-3e98-401e-952e-4bc3af67730d" path="/var/lib/kubelet/pods/15cbec64-3e98-401e-952e-4bc3af67730d/volumes" Sep 07 23:02:03.899061 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:03.899019 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:05.025495 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:05.025463 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 23:02:05.068268 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:05.068235 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerStarted","Data":"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b"} Sep 07 23:02:05.068425 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:05.068320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerStarted","Data":"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36"} Sep 07 23:02:07.079835 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:07.079743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerStarted","Data":"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf"} Sep 07 23:02:07.079835 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:07.079819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerStarted","Data":"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0"} Sep 07 23:02:07.080334 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:07.079860 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerStarted","Data":"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433"} Sep 07 23:02:07.080334 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:07.079895 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerStarted","Data":"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4"} Sep 07 23:02:07.106711 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:07.106647 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.988049425 podStartE2EDuration="10.106630265s" totalImagesPullingTime="7.097790816s" totalInitContainerRuntime="20.790024ms" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:02:07.104203193 +0000 UTC m=+311.596083440" watchObservedRunningTime="2026-09-07 23:02:07.106630265 +0000 UTC m=+311.598510511" Sep 07 23:02:07.685184 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:07.685138 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:07.779013 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:07.778974 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:07.967127 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:07.967024 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:08.272718 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:08.272622 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:02:08.353365 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:08.353327 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:08.406856 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:08.406815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:09.064823 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:09.064795 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:09.119820 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:09.119785 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:09.368295 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:09.368207 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:09.560445 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:09.560406 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:09.661251 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:09.661220 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:09.761537 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:09.761484 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:09.809922 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:09.809888 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:10.003111 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:10.003014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:11.097923 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:11.097884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:11.200730 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:11.200670 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:22.994941 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:22.994901 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:23.043965 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:23.043933 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:24.068727 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:24.068668 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:24.119549 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:24.119509 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:27.191981 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:27.191929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:27.292514 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:27.292470 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:28.163116 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:28.163085 2575 generic.go:356] "Generic (PLEG): container finished" podID="91e24119-3c8f-4d2b-90a2-15065f0002cf" containerID="5c966c3fa83ba9d552fcbf810bef93e119273388b73ba6ccf3af75c940e32e99" exitCode=0 Sep 07 23:02:28.163302 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:28.163157 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" event={"ID":"91e24119-3c8f-4d2b-90a2-15065f0002cf","Type":"ContainerDied","Data":"5c966c3fa83ba9d552fcbf810bef93e119273388b73ba6ccf3af75c940e32e99"} Sep 07 23:02:28.163521 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:28.163508 2575 scope.go:117] "RemoveContainer" containerID="5c966c3fa83ba9d552fcbf810bef93e119273388b73ba6ccf3af75c940e32e99" Sep 07 23:02:29.169115 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:29.169082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fft2n" event={"ID":"91e24119-3c8f-4d2b-90a2-15065f0002cf","Type":"ContainerStarted","Data":"c99b6c0906ab0970fe5e060738f8586f053d931961d4ade91ec112260fd3bc3f"} Sep 07 23:02:30.576840 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:30.576804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:30.626035 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:30.625993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:31.976667 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:31.976628 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:32.183025 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:32.182998 2575 generic.go:356] "Generic (PLEG): container finished" podID="64e41cdc-3030-478d-bce9-e6f5121c9dc8" containerID="001f3fb3625adb797c1dde821377e4ab427041e0025e4a182f7d5974ffa6d77e" exitCode=0 Sep 07 23:02:32.183139 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:32.183064 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" event={"ID":"64e41cdc-3030-478d-bce9-e6f5121c9dc8","Type":"ContainerDied","Data":"001f3fb3625adb797c1dde821377e4ab427041e0025e4a182f7d5974ffa6d77e"} Sep 07 23:02:32.183392 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:32.183377 2575 scope.go:117] "RemoveContainer" containerID="001f3fb3625adb797c1dde821377e4ab427041e0025e4a182f7d5974ffa6d77e" Sep 07 23:02:33.188927 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:33.188888 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l95qb" event={"ID":"64e41cdc-3030-478d-bce9-e6f5121c9dc8","Type":"ContainerStarted","Data":"0eaa69b57263b83c01d717e13aad2f112ee0f0d9f292ae62296a59b99ecafcb5"} Sep 07 23:02:37.193920 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:37.193885 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:37.294982 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:37.294944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:38.584829 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:38.584790 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:38.635337 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:38.635290 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:39.064330 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:39.064283 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:39.112662 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:39.112623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:39.179506 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:39.179454 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:39.231230 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:39.231175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:54.063921 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:54.063813 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:54.112924 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:54.112893 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:02:58.272483 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:58.272441 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:02:58.297346 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:58.297028 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:02:58.323966 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:02:58.323937 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:05.208891 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:05.208849 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:05.259076 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:05.259046 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:07.812954 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:07.812913 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:07.861217 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:07.861183 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:09.840194 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:09.840155 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 23:03:09.842605 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:09.842577 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25fa86da-a99d-4924-9a7a-7cb993ac385c-metrics-certs\") pod \"network-metrics-daemon-drkv2\" (UID: \"25fa86da-a99d-4924-9a7a-7cb993ac385c\") " pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 23:03:10.129097 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:10.129017 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-247hl\"" Sep 07 23:03:10.136849 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:10.136821 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drkv2" Sep 07 23:03:10.404183 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:10.404157 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-drkv2"] Sep 07 23:03:10.407121 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:03:10.407094 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25fa86da_a99d_4924_9a7a_7cb993ac385c.slice/crio-8b8063c48d20a1b35dff5959220aca19a85ad507521c8e622a2769700245f948 WatchSource:0}: Error finding container 8b8063c48d20a1b35dff5959220aca19a85ad507521c8e622a2769700245f948: Status 404 returned error can't find the container with id 8b8063c48d20a1b35dff5959220aca19a85ad507521c8e622a2769700245f948 Sep 07 23:03:11.358192 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:11.358146 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drkv2" event={"ID":"25fa86da-a99d-4924-9a7a-7cb993ac385c","Type":"ContainerStarted","Data":"8b8063c48d20a1b35dff5959220aca19a85ad507521c8e622a2769700245f948"} Sep 07 23:03:12.364040 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:12.363999 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drkv2" event={"ID":"25fa86da-a99d-4924-9a7a-7cb993ac385c","Type":"ContainerStarted","Data":"66f5d8823d4e67038873abdc0cd79e9398ef7ca6f3b56f9ad7e82cad77234c9c"} Sep 07 23:03:12.364445 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:12.364066 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drkv2" event={"ID":"25fa86da-a99d-4924-9a7a-7cb993ac385c","Type":"ContainerStarted","Data":"21556a2987f41859846a5c9b4c751be2f25d896a5d207ba712c2938e249815eb"} Sep 07 23:03:12.379843 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:12.379778 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-drkv2" podStartSLOduration=375.294360306 podStartE2EDuration="6m16.379762562s" totalImagesPullingTime="1.085402256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:03:12.377643898 +0000 UTC m=+376.869524161" watchObservedRunningTime="2026-09-07 23:03:12.379762562 +0000 UTC m=+376.871642834" Sep 07 23:03:12.461105 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:12.461067 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:12.516087 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:12.516055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:13.091104 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:13.091069 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:13.192332 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:13.192301 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:16.294174 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.294130 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 23:03:16.294732 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.294679 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="prometheus" containerID="cri-o://cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36" gracePeriod=600 Sep 07 23:03:16.295073 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.295008 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy" containerID="cri-o://b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0" gracePeriod=600 Sep 07 23:03:16.295179 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.295155 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy-web" containerID="cri-o://5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433" gracePeriod=600 Sep 07 23:03:16.295554 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.295233 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf" gracePeriod=600 Sep 07 23:03:16.295554 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.295289 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="config-reloader" containerID="cri-o://064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b" gracePeriod=600 Sep 07 23:03:16.295554 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.295313 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="thanos-sidecar" containerID="cri-o://c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4" gracePeriod=600 Sep 07 23:03:16.536476 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.536450 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:16.692771 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.692737 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-tls-assets\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.692952 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.692781 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-metrics-client-certs\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.692952 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.692799 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-2\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.692952 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.692823 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52v4f\" (UniqueName: \"kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-kube-api-access-52v4f\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.692952 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.692849 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-thanos-prometheus-http-client-file\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.692952 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.692870 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-0\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.692952 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.692885 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.692952 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.692908 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-serving-certs-ca-bundle\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.692952 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.692934 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-tls\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.693435 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.693290 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 23:03:16.694215 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.693682 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 23:03:16.694215 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.693785 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-kubelet-serving-ca-bundle\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.694215 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.693832 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-kube-rbac-proxy\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.694215 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.693874 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-metrics-client-ca\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.694215 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.693917 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config-out\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.694215 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.693951 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-web-config\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.694215 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.693983 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-trusted-ca-bundle\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.694215 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.694012 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.694215 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.694052 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-grpc-tls\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.694756 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.694267 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 23:03:16.694756 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.694282 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 23:03:16.694756 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.694729 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 23:03:16.694919 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.694898 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 23:03:16.695277 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.695000 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-1\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.695277 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.695058 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.695277 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.695083 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-db\") pod \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\" (UID: \"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712\") " Sep 07 23:03:16.695484 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.695346 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.695484 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.695366 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.695484 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.695379 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.695484 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.695393 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-configmap-metrics-client-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.695484 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.695407 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.695484 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.695421 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.696919 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.696272 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-kube-api-access-52v4f" (OuterVolumeSpecName: "kube-api-access-52v4f") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "kube-api-access-52v4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 23:03:16.696919 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.696335 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:03:16.696919 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.696641 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 23:03:16.696919 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.696699 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:03:16.696919 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.696798 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:03:16.696919 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.696855 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 23:03:16.696919 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.696903 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 23:03:16.697483 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.697448 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:03:16.697555 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.697501 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config" (OuterVolumeSpecName: "config") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:03:16.698086 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.698060 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:03:16.698315 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.698295 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config-out" (OuterVolumeSpecName: "config-out") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 23:03:16.698711 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.698667 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:03:16.698945 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.698917 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:03:16.709166 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.709131 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-web-config" (OuterVolumeSpecName: "web-config") pod "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" (UID: "0b6e7a9a-b7ea-4982-9d44-0c7f1877e712"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 23:03:16.795804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795759 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.795804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795797 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-db\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.795804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795809 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-tls-assets\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795821 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-metrics-client-certs\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795833 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52v4f\" (UniqueName: \"kubernetes.io/projected/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-kube-api-access-52v4f\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795845 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795857 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795868 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795879 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-kube-rbac-proxy\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795890 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config-out\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795927 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-web-config\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795943 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-config\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795954 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-secret-grpc-tls\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:16.796072 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:16.795966 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:03:17.386831 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386796 2575 generic.go:356] "Generic (PLEG): container finished" podID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerID="9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf" exitCode=0 Sep 07 23:03:17.386831 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386820 2575 generic.go:356] "Generic (PLEG): container finished" podID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerID="b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0" exitCode=0 Sep 07 23:03:17.386831 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386827 2575 generic.go:356] "Generic (PLEG): container finished" podID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerID="5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433" exitCode=0 Sep 07 23:03:17.386831 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386833 2575 generic.go:356] "Generic (PLEG): container finished" podID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerID="c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4" exitCode=0 Sep 07 23:03:17.386831 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386839 2575 generic.go:356] "Generic (PLEG): container finished" podID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerID="064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b" exitCode=0 Sep 07 23:03:17.387411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386844 2575 generic.go:356] "Generic (PLEG): container finished" podID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerID="cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36" exitCode=0 Sep 07 23:03:17.387411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386868 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.387411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386873 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerDied","Data":"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf"} Sep 07 23:03:17.387411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386942 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerDied","Data":"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0"} Sep 07 23:03:17.387411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386971 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerDied","Data":"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433"} Sep 07 23:03:17.387411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.386996 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerDied","Data":"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4"} Sep 07 23:03:17.387411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.387007 2575 scope.go:117] "RemoveContainer" containerID="9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf" Sep 07 23:03:17.387411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.387020 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerDied","Data":"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b"} Sep 07 23:03:17.387411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.387045 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerDied","Data":"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36"} Sep 07 23:03:17.387411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.387069 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b6e7a9a-b7ea-4982-9d44-0c7f1877e712","Type":"ContainerDied","Data":"71717da8ac2d749dc7306b2437e0712f6b96835bcfff6f42ddebf4d5e17100e0"} Sep 07 23:03:17.398598 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.398576 2575 scope.go:117] "RemoveContainer" containerID="b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0" Sep 07 23:03:17.406721 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.406682 2575 scope.go:117] "RemoveContainer" containerID="5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433" Sep 07 23:03:17.414596 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.414566 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 23:03:17.416005 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.415982 2575 scope.go:117] "RemoveContainer" containerID="c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4" Sep 07 23:03:17.417199 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.417181 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 23:03:17.423131 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.423113 2575 scope.go:117] "RemoveContainer" containerID="064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b" Sep 07 23:03:17.430251 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.430233 2575 scope.go:117] "RemoveContainer" containerID="cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36" Sep 07 23:03:17.437872 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.437854 2575 scope.go:117] "RemoveContainer" containerID="dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53" Sep 07 23:03:17.444069 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444048 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 23:03:17.444350 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444337 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy-thanos" Sep 07 23:03:17.444392 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444352 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy-thanos" Sep 07 23:03:17.444392 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444363 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy" Sep 07 23:03:17.444392 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444369 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy" Sep 07 23:03:17.444392 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444379 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="prometheus" Sep 07 23:03:17.444392 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444385 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="prometheus" Sep 07 23:03:17.444392 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444391 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy-web" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444397 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy-web" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444409 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="init-config-reloader" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444414 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="init-config-reloader" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444421 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="config-reloader" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444427 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="config-reloader" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444439 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15cbec64-3e98-401e-952e-4bc3af67730d" containerName="registry" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444445 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15cbec64-3e98-401e-952e-4bc3af67730d" containerName="registry" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444451 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="thanos-sidecar" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444456 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="thanos-sidecar" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444500 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="15cbec64-3e98-401e-952e-4bc3af67730d" containerName="registry" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444506 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="thanos-sidecar" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444511 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy-thanos" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444517 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy-web" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444522 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="prometheus" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444527 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="kube-rbac-proxy" Sep 07 23:03:17.444566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.444533 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" containerName="config-reloader" Sep 07 23:03:17.445234 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.445202 2575 scope.go:117] "RemoveContainer" containerID="9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf" Sep 07 23:03:17.445539 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:03:17.445520 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": container with ID starting with 9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf not found: ID does not exist" containerID="9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf" Sep 07 23:03:17.445593 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.445550 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf"} err="failed to get container status \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": rpc error: code = NotFound desc = could not find container \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": container with ID starting with 9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf not found: ID does not exist" Sep 07 23:03:17.445593 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.445568 2575 scope.go:117] "RemoveContainer" containerID="b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0" Sep 07 23:03:17.445869 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:03:17.445850 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": container with ID starting with b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0 not found: ID does not exist" containerID="b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0" Sep 07 23:03:17.445918 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.445877 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0"} err="failed to get container status \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": rpc error: code = NotFound desc = could not find container \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": container with ID starting with b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0 not found: ID does not exist" Sep 07 23:03:17.445918 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.445894 2575 scope.go:117] "RemoveContainer" containerID="5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433" Sep 07 23:03:17.446159 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:03:17.446140 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": container with ID starting with 5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433 not found: ID does not exist" containerID="5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433" Sep 07 23:03:17.446210 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.446165 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433"} err="failed to get container status \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": rpc error: code = NotFound desc = could not find container \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": container with ID starting with 5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433 not found: ID does not exist" Sep 07 23:03:17.446210 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.446182 2575 scope.go:117] "RemoveContainer" containerID="c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4" Sep 07 23:03:17.446459 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:03:17.446440 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": container with ID starting with c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4 not found: ID does not exist" containerID="c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4" Sep 07 23:03:17.446498 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.446464 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4"} err="failed to get container status \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": rpc error: code = NotFound desc = could not find container \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": container with ID starting with c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4 not found: ID does not exist" Sep 07 23:03:17.446498 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.446477 2575 scope.go:117] "RemoveContainer" containerID="064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b" Sep 07 23:03:17.446772 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:03:17.446678 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": container with ID starting with 064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b not found: ID does not exist" containerID="064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b" Sep 07 23:03:17.446849 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.446776 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b"} err="failed to get container status \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": rpc error: code = NotFound desc = could not find container \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": container with ID starting with 064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b not found: ID does not exist" Sep 07 23:03:17.446849 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.446790 2575 scope.go:117] "RemoveContainer" containerID="cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36" Sep 07 23:03:17.447127 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:03:17.447105 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": container with ID starting with cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36 not found: ID does not exist" containerID="cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36" Sep 07 23:03:17.447178 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.447131 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36"} err="failed to get container status \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": rpc error: code = NotFound desc = could not find container \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": container with ID starting with cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36 not found: ID does not exist" Sep 07 23:03:17.447178 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.447144 2575 scope.go:117] "RemoveContainer" containerID="dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53" Sep 07 23:03:17.447373 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:03:17.447359 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": container with ID starting with dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53 not found: ID does not exist" containerID="dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53" Sep 07 23:03:17.447418 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.447376 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53"} err="failed to get container status \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": rpc error: code = NotFound desc = could not find container \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": container with ID starting with dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53 not found: ID does not exist" Sep 07 23:03:17.447418 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.447388 2575 scope.go:117] "RemoveContainer" containerID="9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf" Sep 07 23:03:17.447638 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.447620 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf"} err="failed to get container status \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": rpc error: code = NotFound desc = could not find container \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": container with ID starting with 9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf not found: ID does not exist" Sep 07 23:03:17.447638 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.447638 2575 scope.go:117] "RemoveContainer" containerID="b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0" Sep 07 23:03:17.447878 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.447864 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0"} err="failed to get container status \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": rpc error: code = NotFound desc = could not find container \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": container with ID starting with b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0 not found: ID does not exist" Sep 07 23:03:17.447878 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.447877 2575 scope.go:117] "RemoveContainer" containerID="5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433" Sep 07 23:03:17.448090 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.448069 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433"} err="failed to get container status \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": rpc error: code = NotFound desc = could not find container \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": container with ID starting with 5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433 not found: ID does not exist" Sep 07 23:03:17.448090 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.448089 2575 scope.go:117] "RemoveContainer" containerID="c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4" Sep 07 23:03:17.448321 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.448306 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4"} err="failed to get container status \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": rpc error: code = NotFound desc = could not find container \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": container with ID starting with c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4 not found: ID does not exist" Sep 07 23:03:17.448368 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.448322 2575 scope.go:117] "RemoveContainer" containerID="064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b" Sep 07 23:03:17.448545 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.448528 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b"} err="failed to get container status \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": rpc error: code = NotFound desc = could not find container \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": container with ID starting with 064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b not found: ID does not exist" Sep 07 23:03:17.448545 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.448544 2575 scope.go:117] "RemoveContainer" containerID="cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36" Sep 07 23:03:17.448734 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.448718 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36"} err="failed to get container status \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": rpc error: code = NotFound desc = could not find container \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": container with ID starting with cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36 not found: ID does not exist" Sep 07 23:03:17.448781 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.448734 2575 scope.go:117] "RemoveContainer" containerID="dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53" Sep 07 23:03:17.448939 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.448926 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53"} err="failed to get container status \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": rpc error: code = NotFound desc = could not find container \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": container with ID starting with dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53 not found: ID does not exist" Sep 07 23:03:17.448982 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.448938 2575 scope.go:117] "RemoveContainer" containerID="9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf" Sep 07 23:03:17.449138 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.449122 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf"} err="failed to get container status \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": rpc error: code = NotFound desc = could not find container \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": container with ID starting with 9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf not found: ID does not exist" Sep 07 23:03:17.449138 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.449137 2575 scope.go:117] "RemoveContainer" containerID="b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0" Sep 07 23:03:17.449347 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.449326 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0"} err="failed to get container status \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": rpc error: code = NotFound desc = could not find container \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": container with ID starting with b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0 not found: ID does not exist" Sep 07 23:03:17.449391 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.449348 2575 scope.go:117] "RemoveContainer" containerID="5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433" Sep 07 23:03:17.449548 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.449532 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433"} err="failed to get container status \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": rpc error: code = NotFound desc = could not find container \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": container with ID starting with 5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433 not found: ID does not exist" Sep 07 23:03:17.449548 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.449546 2575 scope.go:117] "RemoveContainer" containerID="c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4" Sep 07 23:03:17.449620 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.449551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.449963 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.449828 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4"} err="failed to get container status \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": rpc error: code = NotFound desc = could not find container \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": container with ID starting with c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4 not found: ID does not exist" Sep 07 23:03:17.449963 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.449863 2575 scope.go:117] "RemoveContainer" containerID="064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b" Sep 07 23:03:17.450161 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.450139 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b"} err="failed to get container status \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": rpc error: code = NotFound desc = could not find container \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": container with ID starting with 064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b not found: ID does not exist" Sep 07 23:03:17.450204 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.450161 2575 scope.go:117] "RemoveContainer" containerID="cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36" Sep 07 23:03:17.450411 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.450391 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36"} err="failed to get container status \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": rpc error: code = NotFound desc = could not find container \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": container with ID starting with cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36 not found: ID does not exist" Sep 07 23:03:17.450469 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.450412 2575 scope.go:117] "RemoveContainer" containerID="dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53" Sep 07 23:03:17.450656 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.450640 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53"} err="failed to get container status \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": rpc error: code = NotFound desc = could not find container \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": container with ID starting with dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53 not found: ID does not exist" Sep 07 23:03:17.450712 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.450656 2575 scope.go:117] "RemoveContainer" containerID="9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf" Sep 07 23:03:17.450884 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.450869 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf"} err="failed to get container status \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": rpc error: code = NotFound desc = could not find container \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": container with ID starting with 9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf not found: ID does not exist" Sep 07 23:03:17.450884 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.450884 2575 scope.go:117] "RemoveContainer" containerID="b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0" Sep 07 23:03:17.451104 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.451088 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0"} err="failed to get container status \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": rpc error: code = NotFound desc = could not find container \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": container with ID starting with b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0 not found: ID does not exist" Sep 07 23:03:17.451104 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.451104 2575 scope.go:117] "RemoveContainer" containerID="5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433" Sep 07 23:03:17.451350 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.451330 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433"} err="failed to get container status \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": rpc error: code = NotFound desc = could not find container \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": container with ID starting with 5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433 not found: ID does not exist" Sep 07 23:03:17.451391 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.451353 2575 scope.go:117] "RemoveContainer" containerID="c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4" Sep 07 23:03:17.451577 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.451556 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4"} err="failed to get container status \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": rpc error: code = NotFound desc = could not find container \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": container with ID starting with c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4 not found: ID does not exist" Sep 07 23:03:17.451630 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.451579 2575 scope.go:117] "RemoveContainer" containerID="064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b" Sep 07 23:03:17.451930 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.451908 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b"} err="failed to get container status \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": rpc error: code = NotFound desc = could not find container \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": container with ID starting with 064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b not found: ID does not exist" Sep 07 23:03:17.452034 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.451931 2575 scope.go:117] "RemoveContainer" containerID="cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36" Sep 07 23:03:17.452034 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.451978 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 23:03:17.452034 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.451985 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 23:03:17.452287 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452236 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36"} err="failed to get container status \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": rpc error: code = NotFound desc = could not find container \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": container with ID starting with cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36 not found: ID does not exist" Sep 07 23:03:17.452287 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452263 2575 scope.go:117] "RemoveContainer" containerID="dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53" Sep 07 23:03:17.452600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452300 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 23:03:17.452600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452310 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 23:03:17.452600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452243 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 23:03:17.452600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452352 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 23:03:17.452600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452359 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 23:03:17.452600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452310 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9mj7jje8e3fc7\"" Sep 07 23:03:17.452600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452568 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53"} err="failed to get container status \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": rpc error: code = NotFound desc = could not find container \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": container with ID starting with dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53 not found: ID does not exist" Sep 07 23:03:17.452600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452591 2575 scope.go:117] "RemoveContainer" containerID="9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf" Sep 07 23:03:17.452961 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452709 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 23:03:17.452961 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452735 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 23:03:17.452961 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452772 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 23:03:17.452961 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452780 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 23:03:17.452961 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452813 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 23:03:17.452961 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452879 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf"} err="failed to get container status \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": rpc error: code = NotFound desc = could not find container \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": container with ID starting with 9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf not found: ID does not exist" Sep 07 23:03:17.452961 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452902 2575 scope.go:117] "RemoveContainer" containerID="b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0" Sep 07 23:03:17.452961 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.452948 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n898t\"" Sep 07 23:03:17.453282 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.453134 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0"} err="failed to get container status \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": rpc error: code = NotFound desc = could not find container \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": container with ID starting with b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0 not found: ID does not exist" Sep 07 23:03:17.453282 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.453156 2575 scope.go:117] "RemoveContainer" containerID="5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433" Sep 07 23:03:17.453282 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.453204 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 23:03:17.453453 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.453410 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433"} err="failed to get container status \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": rpc error: code = NotFound desc = could not find container \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": container with ID starting with 5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433 not found: ID does not exist" Sep 07 23:03:17.453453 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.453431 2575 scope.go:117] "RemoveContainer" containerID="c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4" Sep 07 23:03:17.453725 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.453681 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4"} err="failed to get container status \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": rpc error: code = NotFound desc = could not find container \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": container with ID starting with c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4 not found: ID does not exist" Sep 07 23:03:17.453725 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.453725 2575 scope.go:117] "RemoveContainer" containerID="064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b" Sep 07 23:03:17.454004 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.453977 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b"} err="failed to get container status \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": rpc error: code = NotFound desc = could not find container \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": container with ID starting with 064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b not found: ID does not exist" Sep 07 23:03:17.454095 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.454005 2575 scope.go:117] "RemoveContainer" containerID="cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36" Sep 07 23:03:17.454368 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.454259 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36"} err="failed to get container status \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": rpc error: code = NotFound desc = could not find container \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": container with ID starting with cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36 not found: ID does not exist" Sep 07 23:03:17.454368 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.454287 2575 scope.go:117] "RemoveContainer" containerID="dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53" Sep 07 23:03:17.454558 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.454534 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53"} err="failed to get container status \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": rpc error: code = NotFound desc = could not find container \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": container with ID starting with dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53 not found: ID does not exist" Sep 07 23:03:17.454620 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.454559 2575 scope.go:117] "RemoveContainer" containerID="9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf" Sep 07 23:03:17.454896 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.454868 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf"} err="failed to get container status \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": rpc error: code = NotFound desc = could not find container \"9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf\": container with ID starting with 9dd36ab9584979108099c420ad2961037d5fb22972b295935a22b58219d1bdaf not found: ID does not exist" Sep 07 23:03:17.454896 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.454895 2575 scope.go:117] "RemoveContainer" containerID="b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0" Sep 07 23:03:17.455165 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.455142 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0"} err="failed to get container status \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": rpc error: code = NotFound desc = could not find container \"b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0\": container with ID starting with b9ccda80b75f3fe47fc4aefe7fdc8c1613abdaae476d913c15272495ca9bc2b0 not found: ID does not exist" Sep 07 23:03:17.455165 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.455163 2575 scope.go:117] "RemoveContainer" containerID="5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433" Sep 07 23:03:17.455439 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.455417 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433"} err="failed to get container status \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": rpc error: code = NotFound desc = could not find container \"5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433\": container with ID starting with 5b8fe32d5587998862e34c983acca15996af0f5076239a9db9f863ff6055a433 not found: ID does not exist" Sep 07 23:03:17.455506 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.455446 2575 scope.go:117] "RemoveContainer" containerID="c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4" Sep 07 23:03:17.455506 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.455427 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 23:03:17.455817 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.455797 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4"} err="failed to get container status \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": rpc error: code = NotFound desc = could not find container \"c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4\": container with ID starting with c8902ce968a41cad7043928eb228942a4bb2ecf372ec71c5e3a3f059ac636fa4 not found: ID does not exist" Sep 07 23:03:17.455817 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.455816 2575 scope.go:117] "RemoveContainer" containerID="064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b" Sep 07 23:03:17.456091 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.456073 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b"} err="failed to get container status \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": rpc error: code = NotFound desc = could not find container \"064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b\": container with ID starting with 064fc14085c920e4441c349e5ba455f249acdaec04a26929dbf13208934d0f2b not found: ID does not exist" Sep 07 23:03:17.456091 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.456090 2575 scope.go:117] "RemoveContainer" containerID="cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36" Sep 07 23:03:17.456315 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.456296 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36"} err="failed to get container status \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": rpc error: code = NotFound desc = could not find container \"cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36\": container with ID starting with cb0982779e94efe27d71b096ce58ac7fdbfdf9e27e9eea60e3bab917fa6eca36 not found: ID does not exist" Sep 07 23:03:17.456315 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.456312 2575 scope.go:117] "RemoveContainer" containerID="dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53" Sep 07 23:03:17.456603 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.456581 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53"} err="failed to get container status \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": rpc error: code = NotFound desc = could not find container \"dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53\": container with ID starting with dc3c84e75de9dadca45cee66fe4ec448d4a7a2b2e2e82217928e8e6d4a169a53 not found: ID does not exist" Sep 07 23:03:17.457782 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.457670 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 23:03:17.467488 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.467464 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 23:03:17.501708 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.501655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.501874 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.501714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.501874 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.501740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.501874 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.501758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.501874 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.501781 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93c1360c-4244-48f1-b531-e773ad3ce70d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.501874 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.501799 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hbsq\" (UniqueName: \"kubernetes.io/projected/93c1360c-4244-48f1-b531-e773ad3ce70d-kube-api-access-7hbsq\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502033 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.501881 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502033 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.501910 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502033 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.501927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502033 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.501966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502033 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.502000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502033 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.502026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502210 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.502044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-web-config\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502210 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.502061 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93c1360c-4244-48f1-b531-e773ad3ce70d-config-out\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502210 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.502082 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502210 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.502135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502210 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.502159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502210 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.502195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502379 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.502223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-config\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.502379 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.502245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.603079 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.602989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-config\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.603079 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603028 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.603079 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603055 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.603079 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603070 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603101 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93c1360c-4244-48f1-b531-e773ad3ce70d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603138 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hbsq\" (UniqueName: \"kubernetes.io/projected/93c1360c-4244-48f1-b531-e773ad3ce70d-kube-api-access-7hbsq\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603175 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603780 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603868 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603937 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-web-config\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.604016 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.604021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93c1360c-4244-48f1-b531-e773ad3ce70d-config-out\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604094 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.604081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604883 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.604134 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604883 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.604161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604883 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.604192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.604883 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.604273 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.605085 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.604935 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.606113 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.606018 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.606857 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.606358 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93c1360c-4244-48f1-b531-e773ad3ce70d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.606857 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.603965 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.606857 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.606480 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.606857 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.606610 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93c1360c-4244-48f1-b531-e773ad3ce70d-config-out\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.606857 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.606619 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.606857 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.606756 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-config\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.608027 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.606951 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.608027 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.607584 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.608906 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.608864 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.609019 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.608983 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.609077 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.609035 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.609134 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.609117 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93c1360c-4244-48f1-b531-e773ad3ce70d-web-config\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.610401 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.610375 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93c1360c-4244-48f1-b531-e773ad3ce70d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.610793 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.610779 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hbsq\" (UniqueName: \"kubernetes.io/projected/93c1360c-4244-48f1-b531-e773ad3ce70d-kube-api-access-7hbsq\") pod \"prometheus-k8s-0\" (UID: \"93c1360c-4244-48f1-b531-e773ad3ce70d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:17.760318 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:17.760272 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:18.031583 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:18.031546 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b6e7a9a-b7ea-4982-9d44-0c7f1877e712" path="/var/lib/kubelet/pods/0b6e7a9a-b7ea-4982-9d44-0c7f1877e712/volumes" Sep 07 23:03:18.042133 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:18.042107 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 23:03:18.044292 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:03:18.044271 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c1360c_4244_48f1_b531_e773ad3ce70d.slice/crio-82262a4a741dc654fb773d5c8e86a19958d1f09aa76e875e55a57cb3de6c52af WatchSource:0}: Error finding container 82262a4a741dc654fb773d5c8e86a19958d1f09aa76e875e55a57cb3de6c52af: Status 404 returned error can't find the container with id 82262a4a741dc654fb773d5c8e86a19958d1f09aa76e875e55a57cb3de6c52af Sep 07 23:03:18.393216 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:18.393178 2575 generic.go:356] "Generic (PLEG): container finished" podID="93c1360c-4244-48f1-b531-e773ad3ce70d" containerID="48618ed0e320c76fdba55a7c10b3cd2c5ced4270b1f33093365064e5dc1ce216" exitCode=0 Sep 07 23:03:18.393672 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:18.393261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93c1360c-4244-48f1-b531-e773ad3ce70d","Type":"ContainerDied","Data":"48618ed0e320c76fdba55a7c10b3cd2c5ced4270b1f33093365064e5dc1ce216"} Sep 07 23:03:18.393672 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:18.393389 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93c1360c-4244-48f1-b531-e773ad3ce70d","Type":"ContainerStarted","Data":"82262a4a741dc654fb773d5c8e86a19958d1f09aa76e875e55a57cb3de6c52af"} Sep 07 23:03:19.401359 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:19.401326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93c1360c-4244-48f1-b531-e773ad3ce70d","Type":"ContainerStarted","Data":"bc85d566ac97b9eacbc61cf86b131ab6fe3399edcfab8df30a54360183edc66f"} Sep 07 23:03:19.401729 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:19.401387 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93c1360c-4244-48f1-b531-e773ad3ce70d","Type":"ContainerStarted","Data":"40180921df38b9b144484978d2d7494335fc190774c85d4c12b04e309f19965d"} Sep 07 23:03:19.401729 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:19.401415 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93c1360c-4244-48f1-b531-e773ad3ce70d","Type":"ContainerStarted","Data":"1d71823b36d707c1baf41b59a6fe7d9ffe0c05264248add8039a8eb5af592f68"} Sep 07 23:03:19.401729 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:19.401440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93c1360c-4244-48f1-b531-e773ad3ce70d","Type":"ContainerStarted","Data":"2d99f99f23069003bbf5a570fb405fb917452bd8c6fa40799ac6eea55f3ff872"} Sep 07 23:03:19.401729 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:19.401464 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93c1360c-4244-48f1-b531-e773ad3ce70d","Type":"ContainerStarted","Data":"62aa95d9d8866e4914f12a1e6438435a5caa19eecad3abdb5002a8d60d0abbe5"} Sep 07 23:03:19.401729 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:19.401486 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93c1360c-4244-48f1-b531-e773ad3ce70d","Type":"ContainerStarted","Data":"d2730293c53aeb428d45d6ed1fc3cbade0d4523d4d50c93a72190dddd4d8df0e"} Sep 07 23:03:19.427217 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:19.427156 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.407967683 podStartE2EDuration="2.42713855s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.170867ms" isStatefulPod=false podCreationTimestamp="2026-09-07 23:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:03:19.425667239 +0000 UTC m=+383.917547518" watchObservedRunningTime="2026-09-07 23:03:19.42713855 +0000 UTC m=+383.919018813" Sep 07 23:03:19.809437 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:19.809345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:19.858116 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:19.858084 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:22.761344 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:22.761283 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:03:24.068475 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:24.068432 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:24.166462 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:24.166428 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:27.334849 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:27.334816 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:27.382873 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:27.382843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:38.372144 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:38.372106 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:38.473531 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:38.473488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:38.519905 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:38.519870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:03:55.158189 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:03:55.158130 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:02.328227 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:02.328188 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:02.436191 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:02.436157 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:02.528360 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:02.528322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:03.677799 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:03.677755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:03.738682 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:03.738640 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:04.620699 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:04.620660 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:07.236966 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:07.236931 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:07.338775 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:07.338742 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:07.435525 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:07.435489 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:07.485310 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:07.485270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:10.301599 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:10.301550 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:11.590832 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:11.590796 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:11.692178 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:11.692140 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:17.761318 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:17.761281 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:04:17.777153 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:17.777125 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:04:18.653506 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:18.653474 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 23:04:37.946802 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:37.946744 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:39.580780 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:39.580746 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:39.747124 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:39.747085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:40.866019 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:40.865984 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:41.004264 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.004219 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2"] Sep 07 23:04:41.007744 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.007721 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.010150 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.010125 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 07 23:04:41.010301 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.010174 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 07 23:04:41.010301 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.010189 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 07 23:04:41.010301 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.010275 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 07 23:04:41.010301 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.010294 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-92cq4\"" Sep 07 23:04:41.010879 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.010863 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 07 23:04:41.023432 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.023403 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2"] Sep 07 23:04:41.097631 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.097593 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lh6j\" (UniqueName: \"kubernetes.io/projected/637c395c-d6dc-4459-9715-1a49e650b436-kube-api-access-4lh6j\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.097631 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.097633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/637c395c-d6dc-4459-9715-1a49e650b436-manifests\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.097877 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.097658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/637c395c-d6dc-4459-9715-1a49e650b436-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.097877 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.097788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637c395c-d6dc-4459-9715-1a49e650b436-tmp\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.097877 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.097824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/637c395c-d6dc-4459-9715-1a49e650b436-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.097877 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.097872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/637c395c-d6dc-4459-9715-1a49e650b436-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.149110 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.149012 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:41.199254 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.199211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637c395c-d6dc-4459-9715-1a49e650b436-tmp\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.199254 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.199255 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/637c395c-d6dc-4459-9715-1a49e650b436-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.199518 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.199282 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/637c395c-d6dc-4459-9715-1a49e650b436-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.199518 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.199326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lh6j\" (UniqueName: \"kubernetes.io/projected/637c395c-d6dc-4459-9715-1a49e650b436-kube-api-access-4lh6j\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.199518 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.199347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/637c395c-d6dc-4459-9715-1a49e650b436-manifests\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.199518 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.199366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/637c395c-d6dc-4459-9715-1a49e650b436-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.199808 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.199779 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/637c395c-d6dc-4459-9715-1a49e650b436-manifests\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.201720 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.201670 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637c395c-d6dc-4459-9715-1a49e650b436-tmp\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.201999 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.201980 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/637c395c-d6dc-4459-9715-1a49e650b436-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.202085 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.202064 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/637c395c-d6dc-4459-9715-1a49e650b436-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.202142 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.202087 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/637c395c-d6dc-4459-9715-1a49e650b436-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.206740 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.206718 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lh6j\" (UniqueName: \"kubernetes.io/projected/637c395c-d6dc-4459-9715-1a49e650b436-kube-api-access-4lh6j\") pod \"opendatahub-operator-controller-manager-6f7668fc86-pwcn2\" (UID: \"637c395c-d6dc-4459-9715-1a49e650b436\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.249188 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.249154 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:41.317894 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.317858 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:41.353943 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.353894 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:41.450427 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.450388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:41.553099 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.553066 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:41.600967 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.600932 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2"] Sep 07 23:04:41.606055 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:04:41.606020 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637c395c_d6dc_4459_9715_1a49e650b436.slice/crio-8e344a4911e66a6378cc6bc531790842ea66cc38c2e1a02e7342ad56a581d4e8 WatchSource:0}: Error finding container 8e344a4911e66a6378cc6bc531790842ea66cc38c2e1a02e7342ad56a581d4e8: Status 404 returned error can't find the container with id 8e344a4911e66a6378cc6bc531790842ea66cc38c2e1a02e7342ad56a581d4e8 Sep 07 23:04:41.729885 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:41.729802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" event={"ID":"637c395c-d6dc-4459-9715-1a49e650b436","Type":"ContainerStarted","Data":"8e344a4911e66a6378cc6bc531790842ea66cc38c2e1a02e7342ad56a581d4e8"} Sep 07 23:04:43.139065 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:43.139007 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:44.660194 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:44.660162 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:44.747302 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:44.747263 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" event={"ID":"637c395c-d6dc-4459-9715-1a49e650b436","Type":"ContainerStarted","Data":"54e5484ff4ca1d9a2f3619c1cb62eb0152e9899abd3a7df412fe3a777db62583"} Sep 07 23:04:45.753674 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:45.753635 2575 generic.go:356] "Generic (PLEG): container finished" podID="637c395c-d6dc-4459-9715-1a49e650b436" containerID="54e5484ff4ca1d9a2f3619c1cb62eb0152e9899abd3a7df412fe3a777db62583" exitCode=0 Sep 07 23:04:45.754102 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:45.753732 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" event={"ID":"637c395c-d6dc-4459-9715-1a49e650b436","Type":"ContainerDied","Data":"54e5484ff4ca1d9a2f3619c1cb62eb0152e9899abd3a7df412fe3a777db62583"} Sep 07 23:04:46.001032 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:46.000990 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:46.575253 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:46.575216 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:46.761626 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:46.761590 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" event={"ID":"637c395c-d6dc-4459-9715-1a49e650b436","Type":"ContainerStarted","Data":"31d7e92a17829716f53fed907c529377691fa76557b50e040ecaa02570b3af9f"} Sep 07 23:04:46.762009 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:46.761719 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:46.790718 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:46.790644 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" podStartSLOduration=3.252325214 podStartE2EDuration="6.790627415s" totalImagesPullingTime="3.095697731s" totalInitContainerRuntime="442.60447ms" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:04:46.789367439 +0000 UTC m=+471.281247696" watchObservedRunningTime="2026-09-07 23:04:46.790627415 +0000 UTC m=+471.282507661" Sep 07 23:04:46.967055 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:46.967007 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:49.240055 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:49.240014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:50.739956 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:50.739906 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:51.164361 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:51.164330 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:51.735745 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:51.735711 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:52.015084 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:52.014997 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:52.572851 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:52.572806 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:53.785486 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:53.785441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:56.556882 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:56.556846 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:56.657627 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:56.657588 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:57.187603 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:57.187563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:57.769524 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:57.769493 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-pwcn2" Sep 07 23:04:59.095706 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.095656 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:59.209471 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.209433 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:59.336586 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.336544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:59.461087 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.461052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:04:59.827179 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.827093 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5c2d8"] Sep 07 23:04:59.834608 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.834581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" Sep 07 23:04:59.837441 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.837422 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-775wv\"" Sep 07 23:04:59.837671 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.837656 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 07 23:04:59.838333 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.838316 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 07 23:04:59.858957 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.858926 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5c2d8"] Sep 07 23:04:59.911698 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.911646 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf"] Sep 07 23:04:59.913856 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.913832 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" Sep 07 23:04:59.916819 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.916795 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 07 23:04:59.916935 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.916843 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 07 23:04:59.916935 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.916864 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-czhzt\"" Sep 07 23:04:59.926008 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.925979 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf"] Sep 07 23:04:59.963364 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.963314 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm8f4\" (UniqueName: \"kubernetes.io/projected/ddb6ae64-6d6b-4441-ab43-da28b75f4811-kube-api-access-lm8f4\") pod \"cert-manager-webhook-6486ffd997-5c2d8\" (UID: \"ddb6ae64-6d6b-4441-ab43-da28b75f4811\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" Sep 07 23:04:59.963539 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:04:59.963431 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddb6ae64-6d6b-4441-ab43-da28b75f4811-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5c2d8\" (UID: \"ddb6ae64-6d6b-4441-ab43-da28b75f4811\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" Sep 07 23:05:00.063957 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.063913 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgpxq\" (UniqueName: \"kubernetes.io/projected/e5db2eab-7866-45af-9bbe-305dca89e0b8-kube-api-access-fgpxq\") pod \"jobset-operator-56d489b4b8-l28jf\" (UID: \"e5db2eab-7866-45af-9bbe-305dca89e0b8\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" Sep 07 23:05:00.064107 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.063970 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddb6ae64-6d6b-4441-ab43-da28b75f4811-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5c2d8\" (UID: \"ddb6ae64-6d6b-4441-ab43-da28b75f4811\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" Sep 07 23:05:00.064107 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.063996 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5db2eab-7866-45af-9bbe-305dca89e0b8-tmp\") pod \"jobset-operator-56d489b4b8-l28jf\" (UID: \"e5db2eab-7866-45af-9bbe-305dca89e0b8\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" Sep 07 23:05:00.064107 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.064040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm8f4\" (UniqueName: \"kubernetes.io/projected/ddb6ae64-6d6b-4441-ab43-da28b75f4811-kube-api-access-lm8f4\") pod \"cert-manager-webhook-6486ffd997-5c2d8\" (UID: \"ddb6ae64-6d6b-4441-ab43-da28b75f4811\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" Sep 07 23:05:00.072603 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.072568 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddb6ae64-6d6b-4441-ab43-da28b75f4811-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5c2d8\" (UID: \"ddb6ae64-6d6b-4441-ab43-da28b75f4811\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" Sep 07 23:05:00.072740 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.072645 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm8f4\" (UniqueName: \"kubernetes.io/projected/ddb6ae64-6d6b-4441-ab43-da28b75f4811-kube-api-access-lm8f4\") pod \"cert-manager-webhook-6486ffd997-5c2d8\" (UID: \"ddb6ae64-6d6b-4441-ab43-da28b75f4811\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" Sep 07 23:05:00.143420 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.143324 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" Sep 07 23:05:00.164644 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.164611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5db2eab-7866-45af-9bbe-305dca89e0b8-tmp\") pod \"jobset-operator-56d489b4b8-l28jf\" (UID: \"e5db2eab-7866-45af-9bbe-305dca89e0b8\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" Sep 07 23:05:00.164877 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.164751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgpxq\" (UniqueName: \"kubernetes.io/projected/e5db2eab-7866-45af-9bbe-305dca89e0b8-kube-api-access-fgpxq\") pod \"jobset-operator-56d489b4b8-l28jf\" (UID: \"e5db2eab-7866-45af-9bbe-305dca89e0b8\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" Sep 07 23:05:00.165046 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.165023 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5db2eab-7866-45af-9bbe-305dca89e0b8-tmp\") pod \"jobset-operator-56d489b4b8-l28jf\" (UID: \"e5db2eab-7866-45af-9bbe-305dca89e0b8\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" Sep 07 23:05:00.174277 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.174232 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgpxq\" (UniqueName: \"kubernetes.io/projected/e5db2eab-7866-45af-9bbe-305dca89e0b8-kube-api-access-fgpxq\") pod \"jobset-operator-56d489b4b8-l28jf\" (UID: \"e5db2eab-7866-45af-9bbe-305dca89e0b8\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" Sep 07 23:05:00.223216 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.223180 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" Sep 07 23:05:00.421946 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.421914 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5c2d8"] Sep 07 23:05:00.424865 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:05:00.424822 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddb6ae64_6d6b_4441_ab43_da28b75f4811.slice/crio-5ccd77577d3fd256ab197ee347f763df9ea15cb16dfe6279de5e7d364ef56b92 WatchSource:0}: Error finding container 5ccd77577d3fd256ab197ee347f763df9ea15cb16dfe6279de5e7d364ef56b92: Status 404 returned error can't find the container with id 5ccd77577d3fd256ab197ee347f763df9ea15cb16dfe6279de5e7d364ef56b92 Sep 07 23:05:00.496078 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.496048 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf"] Sep 07 23:05:00.498853 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:05:00.498824 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5db2eab_7866_45af_9bbe_305dca89e0b8.slice/crio-bd2529235da3eea24bf9dd79f292bae48e926a2da34bc841ca41b0bf844f88d3 WatchSource:0}: Error finding container bd2529235da3eea24bf9dd79f292bae48e926a2da34bc841ca41b0bf844f88d3: Status 404 returned error can't find the container with id bd2529235da3eea24bf9dd79f292bae48e926a2da34bc841ca41b0bf844f88d3 Sep 07 23:05:00.829194 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.829098 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" event={"ID":"e5db2eab-7866-45af-9bbe-305dca89e0b8","Type":"ContainerStarted","Data":"bd2529235da3eea24bf9dd79f292bae48e926a2da34bc841ca41b0bf844f88d3"} Sep 07 23:05:00.830452 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:00.830411 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" event={"ID":"ddb6ae64-6d6b-4441-ab43-da28b75f4811","Type":"ContainerStarted","Data":"5ccd77577d3fd256ab197ee347f763df9ea15cb16dfe6279de5e7d364ef56b92"} Sep 07 23:05:01.689795 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:01.689715 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:01.909115 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:01.908824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:01.973452 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:01.971722 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd"] Sep 07 23:05:01.978681 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:01.978271 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" Sep 07 23:05:01.981366 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:01.981132 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7qcsb\"" Sep 07 23:05:01.987351 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:01.987281 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd"] Sep 07 23:05:02.087014 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:02.086972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vx6sd\" (UID: \"9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" Sep 07 23:05:02.087209 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:02.087058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngp8k\" (UniqueName: \"kubernetes.io/projected/9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474-kube-api-access-ngp8k\") pod \"cert-manager-cainjector-559cdd8c87-vx6sd\" (UID: \"9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" Sep 07 23:05:02.189721 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:02.188257 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vx6sd\" (UID: \"9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" Sep 07 23:05:02.189721 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:02.188309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngp8k\" (UniqueName: \"kubernetes.io/projected/9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474-kube-api-access-ngp8k\") pod \"cert-manager-cainjector-559cdd8c87-vx6sd\" (UID: \"9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" Sep 07 23:05:02.198664 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:02.198594 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vx6sd\" (UID: \"9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" Sep 07 23:05:02.203997 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:02.203906 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngp8k\" (UniqueName: \"kubernetes.io/projected/9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474-kube-api-access-ngp8k\") pod \"cert-manager-cainjector-559cdd8c87-vx6sd\" (UID: \"9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" Sep 07 23:05:02.297936 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:02.297838 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" Sep 07 23:05:02.592167 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:02.592048 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:02.676437 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:02.676403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:05.040897 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.040835 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd"] Sep 07 23:05:05.043359 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:05:05.043310 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cc1c907_c93d_4e70_9fe7_e9bcb9bbc474.slice/crio-bf33101b4f3878cc782b0d1369bb1d228534352f1bc7912da90ef09dbaebe879 WatchSource:0}: Error finding container bf33101b4f3878cc782b0d1369bb1d228534352f1bc7912da90ef09dbaebe879: Status 404 returned error can't find the container with id bf33101b4f3878cc782b0d1369bb1d228534352f1bc7912da90ef09dbaebe879 Sep 07 23:05:05.191767 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.191724 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df"] Sep 07 23:05:05.195736 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.195706 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:05.197345 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.197308 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:05.198217 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.198187 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s972z\"" Sep 07 23:05:05.198369 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.198352 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 07 23:05:05.199089 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.199043 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 07 23:05:05.199218 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.199196 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 07 23:05:05.199345 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.199225 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 07 23:05:05.202029 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.202004 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df"] Sep 07 23:05:05.316504 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.316401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-vn7df\" (UID: \"0819d0df-4d9f-42a9-88f4-cda4c0da63ed\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:05.316504 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.316489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pckr\" (UniqueName: \"kubernetes.io/projected/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-kube-api-access-6pckr\") pod \"kuadrant-console-plugin-598f86468b-vn7df\" (UID: \"0819d0df-4d9f-42a9-88f4-cda4c0da63ed\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:05.316678 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.316566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-vn7df\" (UID: \"0819d0df-4d9f-42a9-88f4-cda4c0da63ed\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:05.417238 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.417182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pckr\" (UniqueName: \"kubernetes.io/projected/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-kube-api-access-6pckr\") pod \"kuadrant-console-plugin-598f86468b-vn7df\" (UID: \"0819d0df-4d9f-42a9-88f4-cda4c0da63ed\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:05.417446 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.417373 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-vn7df\" (UID: \"0819d0df-4d9f-42a9-88f4-cda4c0da63ed\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:05.417446 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.417425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-vn7df\" (UID: \"0819d0df-4d9f-42a9-88f4-cda4c0da63ed\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:05.417573 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:05:05.417557 2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Sep 07 23:05:05.417639 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:05:05.417628 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-plugin-serving-cert podName:0819d0df-4d9f-42a9-88f4-cda4c0da63ed nodeName:}" failed. No retries permitted until 2026-09-07 23:05:05.917607255 +0000 UTC m=+490.409487483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-vn7df" (UID: "0819d0df-4d9f-42a9-88f4-cda4c0da63ed") : secret "plugin-serving-cert" not found Sep 07 23:05:05.418118 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.418090 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-vn7df\" (UID: \"0819d0df-4d9f-42a9-88f4-cda4c0da63ed\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:05.427954 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.427922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pckr\" (UniqueName: \"kubernetes.io/projected/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-kube-api-access-6pckr\") pod \"kuadrant-console-plugin-598f86468b-vn7df\" (UID: \"0819d0df-4d9f-42a9-88f4-cda4c0da63ed\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:05.552824 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.552777 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:05.865934 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.865886 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" event={"ID":"e5db2eab-7866-45af-9bbe-305dca89e0b8","Type":"ContainerStarted","Data":"59ed02d601f922da6646312c8ee1a1769a71ddfd2bc5d1245ea393c1a3c95199"} Sep 07 23:05:05.867495 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.867466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" event={"ID":"ddb6ae64-6d6b-4441-ab43-da28b75f4811","Type":"ContainerStarted","Data":"e5e0e85063ffb66f3b04a573d503afacce774f6c703e1e7b2155af2c28cca869"} Sep 07 23:05:05.867660 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.867511 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" Sep 07 23:05:05.870712 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.869376 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" event={"ID":"9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474","Type":"ContainerStarted","Data":"f54a07034753340b1bc7aabac07c4ec910c9aa364f0b8b852cd113b9013bd6c7"} Sep 07 23:05:05.870712 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.869422 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" event={"ID":"9cc1c907-c93d-4e70-9fe7-e9bcb9bbc474","Type":"ContainerStarted","Data":"bf33101b4f3878cc782b0d1369bb1d228534352f1bc7912da90ef09dbaebe879"} Sep 07 23:05:05.884279 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.884226 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-l28jf" podStartSLOduration=2.6004602390000002 podStartE2EDuration="6.884211655s" totalImagesPullingTime="4.283751416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:05.882034345 +0000 UTC m=+490.373914593" watchObservedRunningTime="2026-09-07 23:05:05.884211655 +0000 UTC m=+490.376091910" Sep 07 23:05:05.900548 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.900488 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" podStartSLOduration=2.547009337 podStartE2EDuration="6.900465557s" totalImagesPullingTime="4.35345622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:05.899426933 +0000 UTC m=+490.391307180" watchObservedRunningTime="2026-09-07 23:05:05.900465557 +0000 UTC m=+490.392345820" Sep 07 23:05:05.914581 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.914523 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vx6sd" podStartSLOduration=4.914504955 podStartE2EDuration="4.914504955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:05.913595809 +0000 UTC m=+490.405476058" watchObservedRunningTime="2026-09-07 23:05:05.914504955 +0000 UTC m=+490.406385200" Sep 07 23:05:05.921451 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.921413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-vn7df\" (UID: \"0819d0df-4d9f-42a9-88f4-cda4c0da63ed\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:05.924093 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:05.924057 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0819d0df-4d9f-42a9-88f4-cda4c0da63ed-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-vn7df\" (UID: \"0819d0df-4d9f-42a9-88f4-cda4c0da63ed\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:06.109480 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:06.109442 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" Sep 07 23:05:06.140997 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:06.140959 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:06.241761 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:06.241724 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:06.383498 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:06.383465 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df"] Sep 07 23:05:06.386121 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:05:06.386090 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0819d0df_4d9f_42a9_88f4_cda4c0da63ed.slice/crio-a8231ee88b6b77852daa09f83c90de6068da14b350b41d81bc9e53dd46c6d95b WatchSource:0}: Error finding container a8231ee88b6b77852daa09f83c90de6068da14b350b41d81bc9e53dd46c6d95b: Status 404 returned error can't find the container with id a8231ee88b6b77852daa09f83c90de6068da14b350b41d81bc9e53dd46c6d95b Sep 07 23:05:06.874980 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:06.874938 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" event={"ID":"0819d0df-4d9f-42a9-88f4-cda4c0da63ed","Type":"ContainerStarted","Data":"a8231ee88b6b77852daa09f83c90de6068da14b350b41d81bc9e53dd46c6d95b"} Sep 07 23:05:07.664882 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:07.664843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:07.726629 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:07.726585 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:09.028971 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.028930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:09.130509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.130468 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:09.241630 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.241578 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:09.307188 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.307108 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6db477577b-jds9b"] Sep 07 23:05:09.324165 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.324131 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6db477577b-jds9b"] Sep 07 23:05:09.324347 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.324249 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:09.328286 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.327096 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 07 23:05:09.328286 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.327325 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 07 23:05:09.328286 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.328093 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 07 23:05:09.328582 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.328318 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7zg97\"" Sep 07 23:05:09.328582 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.328539 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 07 23:05:09.330566 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.329582 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:09.423160 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.423055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:09.454022 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.453984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/882d7ef3-9029-4826-81ce-5e1e99dd6a92-tmp\") pod \"kube-auth-proxy-6db477577b-jds9b\" (UID: \"882d7ef3-9029-4826-81ce-5e1e99dd6a92\") " pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:09.454243 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.454054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/882d7ef3-9029-4826-81ce-5e1e99dd6a92-tls-certs\") pod \"kube-auth-proxy-6db477577b-jds9b\" (UID: \"882d7ef3-9029-4826-81ce-5e1e99dd6a92\") " pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:09.454243 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.454112 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdtk5\" (UniqueName: \"kubernetes.io/projected/882d7ef3-9029-4826-81ce-5e1e99dd6a92-kube-api-access-jdtk5\") pod \"kube-auth-proxy-6db477577b-jds9b\" (UID: \"882d7ef3-9029-4826-81ce-5e1e99dd6a92\") " pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:09.517052 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.516908 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bnv69"] Sep 07 23:05:09.521288 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.521235 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:09.522331 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.522310 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" Sep 07 23:05:09.524790 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.524754 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 07 23:05:09.529813 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.529786 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bnv69"] Sep 07 23:05:09.540722 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.540672 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bnv69"] Sep 07 23:05:09.556085 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.555553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/882d7ef3-9029-4826-81ce-5e1e99dd6a92-tmp\") pod \"kube-auth-proxy-6db477577b-jds9b\" (UID: \"882d7ef3-9029-4826-81ce-5e1e99dd6a92\") " pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:09.556085 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.555627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/882d7ef3-9029-4826-81ce-5e1e99dd6a92-tls-certs\") pod \"kube-auth-proxy-6db477577b-jds9b\" (UID: \"882d7ef3-9029-4826-81ce-5e1e99dd6a92\") " pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:09.556425 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.556314 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdtk5\" (UniqueName: \"kubernetes.io/projected/882d7ef3-9029-4826-81ce-5e1e99dd6a92-kube-api-access-jdtk5\") pod \"kube-auth-proxy-6db477577b-jds9b\" (UID: \"882d7ef3-9029-4826-81ce-5e1e99dd6a92\") " pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:09.556544 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:05:09.556480 2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 07 23:05:09.556544 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:05:09.556544 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/882d7ef3-9029-4826-81ce-5e1e99dd6a92-tls-certs podName:882d7ef3-9029-4826-81ce-5e1e99dd6a92 nodeName:}" failed. No retries permitted until 2026-09-07 23:05:10.056529681 +0000 UTC m=+494.548409906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/882d7ef3-9029-4826-81ce-5e1e99dd6a92-tls-certs") pod "kube-auth-proxy-6db477577b-jds9b" (UID: "882d7ef3-9029-4826-81ce-5e1e99dd6a92") : secret "kube-auth-proxy-tls" not found Sep 07 23:05:09.561157 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.561089 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/882d7ef3-9029-4826-81ce-5e1e99dd6a92-tmp\") pod \"kube-auth-proxy-6db477577b-jds9b\" (UID: \"882d7ef3-9029-4826-81ce-5e1e99dd6a92\") " pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:09.567272 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.567241 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdtk5\" (UniqueName: \"kubernetes.io/projected/882d7ef3-9029-4826-81ce-5e1e99dd6a92-kube-api-access-jdtk5\") pod \"kube-auth-proxy-6db477577b-jds9b\" (UID: \"882d7ef3-9029-4826-81ce-5e1e99dd6a92\") " pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:09.613292 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.613186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:09.657349 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.657301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/653a5b44-54fb-4458-b21e-052e1b967d55-config-file\") pod \"limitador-limitador-85d9db4d5d-bnv69\" (UID: \"653a5b44-54fb-4458-b21e-052e1b967d55\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" Sep 07 23:05:09.657547 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.657467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72c5s\" (UniqueName: \"kubernetes.io/projected/653a5b44-54fb-4458-b21e-052e1b967d55-kube-api-access-72c5s\") pod \"limitador-limitador-85d9db4d5d-bnv69\" (UID: \"653a5b44-54fb-4458-b21e-052e1b967d55\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" Sep 07 23:05:09.758973 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.758936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/653a5b44-54fb-4458-b21e-052e1b967d55-config-file\") pod \"limitador-limitador-85d9db4d5d-bnv69\" (UID: \"653a5b44-54fb-4458-b21e-052e1b967d55\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" Sep 07 23:05:09.759170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.759045 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72c5s\" (UniqueName: \"kubernetes.io/projected/653a5b44-54fb-4458-b21e-052e1b967d55-kube-api-access-72c5s\") pod \"limitador-limitador-85d9db4d5d-bnv69\" (UID: \"653a5b44-54fb-4458-b21e-052e1b967d55\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" Sep 07 23:05:09.759672 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.759642 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/653a5b44-54fb-4458-b21e-052e1b967d55-config-file\") pod \"limitador-limitador-85d9db4d5d-bnv69\" (UID: \"653a5b44-54fb-4458-b21e-052e1b967d55\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" Sep 07 23:05:09.767437 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.767410 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72c5s\" (UniqueName: \"kubernetes.io/projected/653a5b44-54fb-4458-b21e-052e1b967d55-kube-api-access-72c5s\") pod \"limitador-limitador-85d9db4d5d-bnv69\" (UID: \"653a5b44-54fb-4458-b21e-052e1b967d55\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" Sep 07 23:05:09.841842 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.841745 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" Sep 07 23:05:09.890626 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.890580 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:09.964034 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:09.963989 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:10.062951 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.062902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/882d7ef3-9029-4826-81ce-5e1e99dd6a92-tls-certs\") pod \"kube-auth-proxy-6db477577b-jds9b\" (UID: \"882d7ef3-9029-4826-81ce-5e1e99dd6a92\") " pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:10.066098 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.066058 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/882d7ef3-9029-4826-81ce-5e1e99dd6a92-tls-certs\") pod \"kube-auth-proxy-6db477577b-jds9b\" (UID: \"882d7ef3-9029-4826-81ce-5e1e99dd6a92\") " pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:10.243378 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.243328 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" Sep 07 23:05:10.325625 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.325587 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:10.427636 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.427594 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:10.524864 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.524777 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:10.673779 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.673741 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-ggqcs"] Sep 07 23:05:10.683601 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.683571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-ggqcs" Sep 07 23:05:10.685384 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.685354 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-ggqcs"] Sep 07 23:05:10.685926 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.685902 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p5msm\"" Sep 07 23:05:10.735448 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.735410 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:10.770672 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.770638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr5p2\" (UniqueName: \"kubernetes.io/projected/a9295aae-dd19-4add-b93c-4f562dc3f0ad-kube-api-access-qr5p2\") pod \"authorino-c548b5d7d-ggqcs\" (UID: \"a9295aae-dd19-4add-b93c-4f562dc3f0ad\") " pod="kuadrant-system/authorino-c548b5d7d-ggqcs" Sep 07 23:05:10.871727 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.871632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr5p2\" (UniqueName: \"kubernetes.io/projected/a9295aae-dd19-4add-b93c-4f562dc3f0ad-kube-api-access-qr5p2\") pod \"authorino-c548b5d7d-ggqcs\" (UID: \"a9295aae-dd19-4add-b93c-4f562dc3f0ad\") " pod="kuadrant-system/authorino-c548b5d7d-ggqcs" Sep 07 23:05:10.879682 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.879621 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr5p2\" (UniqueName: \"kubernetes.io/projected/a9295aae-dd19-4add-b93c-4f562dc3f0ad-kube-api-access-qr5p2\") pod \"authorino-c548b5d7d-ggqcs\" (UID: \"a9295aae-dd19-4add-b93c-4f562dc3f0ad\") " pod="kuadrant-system/authorino-c548b5d7d-ggqcs" Sep 07 23:05:10.996255 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:10.996209 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-ggqcs" Sep 07 23:05:11.152784 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.152744 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:11.253125 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.253088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:11.268861 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.268793 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd"] Sep 07 23:05:11.272256 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.272229 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.274819 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.274764 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Sep 07 23:05:11.274819 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.274800 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-bgmnq\"" Sep 07 23:05:11.275571 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.275539 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 07 23:05:11.275724 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.275588 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 07 23:05:11.281135 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.281057 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd"] Sep 07 23:05:11.375283 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.375255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e627a03b-e75e-4336-aaf4-5c50ecc46a45-manifests\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.375461 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.375293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e627a03b-e75e-4336-aaf4-5c50ecc46a45-tmp\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.375461 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.375371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp7kc\" (UniqueName: \"kubernetes.io/projected/e627a03b-e75e-4336-aaf4-5c50ecc46a45-kube-api-access-mp7kc\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.375461 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.375430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e627a03b-e75e-4336-aaf4-5c50ecc46a45-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.476800 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.476766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e627a03b-e75e-4336-aaf4-5c50ecc46a45-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.476982 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.476846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e627a03b-e75e-4336-aaf4-5c50ecc46a45-manifests\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.476982 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.476864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e627a03b-e75e-4336-aaf4-5c50ecc46a45-tmp\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.476982 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.476904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp7kc\" (UniqueName: \"kubernetes.io/projected/e627a03b-e75e-4336-aaf4-5c50ecc46a45-kube-api-access-mp7kc\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.477292 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.477269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e627a03b-e75e-4336-aaf4-5c50ecc46a45-manifests\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.477364 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.477293 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e627a03b-e75e-4336-aaf4-5c50ecc46a45-tmp\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.477422 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.477405 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e627a03b-e75e-4336-aaf4-5c50ecc46a45-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.484100 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.484071 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp7kc\" (UniqueName: \"kubernetes.io/projected/e627a03b-e75e-4336-aaf4-5c50ecc46a45-kube-api-access-mp7kc\") pod \"kserve-module-controller-manager-54765d59fd-hrrxd\" (UID: \"e627a03b-e75e-4336-aaf4-5c50ecc46a45\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.537275 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.537237 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-ggqcs"] Sep 07 23:05:11.540521 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:05:11.540491 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9295aae_dd19_4add_b93c_4f562dc3f0ad.slice/crio-b584877bca525bd1bd91c8b31de0b5be35ac8da846412ca73268b6eab9733dfe WatchSource:0}: Error finding container b584877bca525bd1bd91c8b31de0b5be35ac8da846412ca73268b6eab9733dfe: Status 404 returned error can't find the container with id b584877bca525bd1bd91c8b31de0b5be35ac8da846412ca73268b6eab9733dfe Sep 07 23:05:11.548190 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.548107 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bnv69"] Sep 07 23:05:11.550571 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:05:11.550539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653a5b44_54fb_4458_b21e_052e1b967d55.slice/crio-f04dd1fc006d2285c0f86add0c7acfb1a68ee1f644ab0919eaec2e25e0a4daea WatchSource:0}: Error finding container f04dd1fc006d2285c0f86add0c7acfb1a68ee1f644ab0919eaec2e25e0a4daea: Status 404 returned error can't find the container with id f04dd1fc006d2285c0f86add0c7acfb1a68ee1f644ab0919eaec2e25e0a4daea Sep 07 23:05:11.552287 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.552227 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6db477577b-jds9b"] Sep 07 23:05:11.553929 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:05:11.553906 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882d7ef3_9029_4826_81ce_5e1e99dd6a92.slice/crio-99aa3e6448a12ae42284a6273c0f0fa5b190b305997b2164c413fa2196251d03 WatchSource:0}: Error finding container 99aa3e6448a12ae42284a6273c0f0fa5b190b305997b2164c413fa2196251d03: Status 404 returned error can't find the container with id 99aa3e6448a12ae42284a6273c0f0fa5b190b305997b2164c413fa2196251d03 Sep 07 23:05:11.605091 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.605053 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:11.743269 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.743182 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:11.850621 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.850566 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:11.878013 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.877983 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5c2d8" Sep 07 23:05:11.878304 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.878283 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd"] Sep 07 23:05:11.881671 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:05:11.881647 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode627a03b_e75e_4336_aaf4_5c50ecc46a45.slice/crio-cc0d380d179bf0407dec9f4ac3d4d4770edf3eaeafe6cf3c4bd979c34570399c WatchSource:0}: Error finding container cc0d380d179bf0407dec9f4ac3d4d4770edf3eaeafe6cf3c4bd979c34570399c: Status 404 returned error can't find the container with id cc0d380d179bf0407dec9f4ac3d4d4770edf3eaeafe6cf3c4bd979c34570399c Sep 07 23:05:11.904226 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.904191 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" event={"ID":"0819d0df-4d9f-42a9-88f4-cda4c0da63ed","Type":"ContainerStarted","Data":"edd382a8dc009b8228040b02ed0eed7ee180ef6d33418c7cddfd612695a1f511"} Sep 07 23:05:11.905666 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.905639 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" event={"ID":"653a5b44-54fb-4458-b21e-052e1b967d55","Type":"ContainerStarted","Data":"f04dd1fc006d2285c0f86add0c7acfb1a68ee1f644ab0919eaec2e25e0a4daea"} Sep 07 23:05:11.907088 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.907059 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" event={"ID":"e627a03b-e75e-4336-aaf4-5c50ecc46a45","Type":"ContainerStarted","Data":"cc0d380d179bf0407dec9f4ac3d4d4770edf3eaeafe6cf3c4bd979c34570399c"} Sep 07 23:05:11.908564 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.908533 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" event={"ID":"882d7ef3-9029-4826-81ce-5e1e99dd6a92","Type":"ContainerStarted","Data":"99aa3e6448a12ae42284a6273c0f0fa5b190b305997b2164c413fa2196251d03"} Sep 07 23:05:11.909935 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.909902 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-ggqcs" event={"ID":"a9295aae-dd19-4add-b93c-4f562dc3f0ad","Type":"ContainerStarted","Data":"b584877bca525bd1bd91c8b31de0b5be35ac8da846412ca73268b6eab9733dfe"} Sep 07 23:05:11.927007 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:11.926951 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vn7df" podStartSLOduration=1.970944474 podStartE2EDuration="6.926931734s" totalImagesPullingTime="4.95598726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:11.926219449 +0000 UTC m=+496.418099722" watchObservedRunningTime="2026-09-07 23:05:11.926931734 +0000 UTC m=+496.418811978" Sep 07 23:05:15.935958 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:15.935924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" event={"ID":"882d7ef3-9029-4826-81ce-5e1e99dd6a92","Type":"ContainerStarted","Data":"c56a69278723318c206440818b53287e692009374fe38da78d04b0e5459f2479"} Sep 07 23:05:15.937478 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:15.937452 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-ggqcs" event={"ID":"a9295aae-dd19-4add-b93c-4f562dc3f0ad","Type":"ContainerStarted","Data":"25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7"} Sep 07 23:05:15.938989 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:15.938940 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" event={"ID":"653a5b44-54fb-4458-b21e-052e1b967d55","Type":"ContainerStarted","Data":"71b9ec5235394705045d63cf94845591797fbb9eb8f1b4255f4dcbbada9e471f"} Sep 07 23:05:15.939096 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:15.939050 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" Sep 07 23:05:15.940449 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:15.940426 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" event={"ID":"e627a03b-e75e-4336-aaf4-5c50ecc46a45","Type":"ContainerStarted","Data":"308283ac0e40990ec9efe58f232bfef7d1276b9371bf7786ddb1be26ba7f1c0d"} Sep 07 23:05:15.940580 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:15.940566 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:15.952925 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:15.952872 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6db477577b-jds9b" podStartSLOduration=3.108435169 podStartE2EDuration="6.952854975s" totalImagesPullingTime="3.844419806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:15.951450673 +0000 UTC m=+500.443330921" watchObservedRunningTime="2026-09-07 23:05:15.952854975 +0000 UTC m=+500.444735222" Sep 07 23:05:15.973502 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:15.973442 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" podStartSLOduration=3.043477733 podStartE2EDuration="6.973422483s" totalImagesPullingTime="3.92994475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:15.973026437 +0000 UTC m=+500.464906685" watchObservedRunningTime="2026-09-07 23:05:15.973422483 +0000 UTC m=+500.465302729" Sep 07 23:05:15.988404 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:15.988354 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-ggqcs" podStartSLOduration=2.04103879 podStartE2EDuration="5.9883338s" totalImagesPullingTime="3.94729501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:15.986928823 +0000 UTC m=+500.478809094" watchObservedRunningTime="2026-09-07 23:05:15.9883338 +0000 UTC m=+500.480214049" Sep 07 23:05:16.002061 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:16.001976 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" podStartSLOduration=1.410950777 podStartE2EDuration="5.00195474s" totalImagesPullingTime="3.591003963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:16.001290038 +0000 UTC m=+500.493170340" watchObservedRunningTime="2026-09-07 23:05:16.00195474 +0000 UTC m=+500.493834989" Sep 07 23:05:16.122901 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:16.122862 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:16.256336 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:16.256233 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:16.343254 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:16.343215 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:26.948487 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:26.948451 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bnv69" Sep 07 23:05:28.474163 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:28.474121 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:28.573915 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:28.573867 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:28.631744 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:28.631702 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:28.717267 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:28.717227 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:28.818430 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:28.818343 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:29.919675 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:29.919633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:30.019600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:30.019563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:31.031619 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:31.031589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:31.182251 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:31.182216 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:36.946293 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:36.946263 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hrrxd" Sep 07 23:05:43.325746 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:43.325709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:43.373022 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:43.372987 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:52.085615 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:52.085515 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:52.186567 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:52.186538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:58.767949 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:58.767891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:05:58.867540 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:05:58.867499 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:00.447950 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:00.447899 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:00.646772 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:00.646731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:01.029335 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.029300 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:01.193674 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.193634 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:01.294420 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.294330 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:01.369971 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.369937 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:01.436610 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.436579 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-rwzk8"] Sep 07 23:06:01.439136 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.439110 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" Sep 07 23:06:01.456509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.456484 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 07 23:06:01.457431 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.457412 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sqz9h\"" Sep 07 23:06:01.468039 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.468008 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-rwzk8"] Sep 07 23:06:01.535936 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.535891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4js5j\" (UniqueName: \"kubernetes.io/projected/3ad6ac05-1808-4697-9d46-93235e17e22f-kube-api-access-4js5j\") pod \"payload-processing-5b54b7fbb7-rwzk8\" (UID: \"3ad6ac05-1808-4697-9d46-93235e17e22f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" Sep 07 23:06:01.536136 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.536053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad6ac05-1808-4697-9d46-93235e17e22f-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-rwzk8\" (UID: \"3ad6ac05-1808-4697-9d46-93235e17e22f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" Sep 07 23:06:01.637441 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.637333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4js5j\" (UniqueName: \"kubernetes.io/projected/3ad6ac05-1808-4697-9d46-93235e17e22f-kube-api-access-4js5j\") pod \"payload-processing-5b54b7fbb7-rwzk8\" (UID: \"3ad6ac05-1808-4697-9d46-93235e17e22f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" Sep 07 23:06:01.637630 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.637464 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad6ac05-1808-4697-9d46-93235e17e22f-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-rwzk8\" (UID: \"3ad6ac05-1808-4697-9d46-93235e17e22f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" Sep 07 23:06:01.638430 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.638404 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad6ac05-1808-4697-9d46-93235e17e22f-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-rwzk8\" (UID: \"3ad6ac05-1808-4697-9d46-93235e17e22f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" Sep 07 23:06:01.657361 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.657326 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4js5j\" (UniqueName: \"kubernetes.io/projected/3ad6ac05-1808-4697-9d46-93235e17e22f-kube-api-access-4js5j\") pod \"payload-processing-5b54b7fbb7-rwzk8\" (UID: \"3ad6ac05-1808-4697-9d46-93235e17e22f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" Sep 07 23:06:01.749905 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:01.749858 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" Sep 07 23:06:02.048617 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:02.048589 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-rwzk8"] Sep 07 23:06:02.051263 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:06:02.051235 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad6ac05_1808_4697_9d46_93235e17e22f.slice/crio-61d21b5da6c4404d903366632cd24b350d0b45da5fd15a9c028b24d6357ad466 WatchSource:0}: Error finding container 61d21b5da6c4404d903366632cd24b350d0b45da5fd15a9c028b24d6357ad466: Status 404 returned error can't find the container with id 61d21b5da6c4404d903366632cd24b350d0b45da5fd15a9c028b24d6357ad466 Sep 07 23:06:02.166380 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:02.166344 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" event={"ID":"3ad6ac05-1808-4697-9d46-93235e17e22f","Type":"ContainerStarted","Data":"61d21b5da6c4404d903366632cd24b350d0b45da5fd15a9c028b24d6357ad466"} Sep 07 23:06:04.179736 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:04.179662 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" event={"ID":"3ad6ac05-1808-4697-9d46-93235e17e22f","Type":"ContainerStarted","Data":"6e12a23bef531d53110f0fa4b6b8cf8f9048a6c22c25690e7bb9ee3d38f1b7b7"} Sep 07 23:06:04.180233 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:04.179839 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" Sep 07 23:06:04.195979 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:04.195929 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" podStartSLOduration=1.588401993 podStartE2EDuration="3.19591245s" totalImagesPullingTime="1.607510457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:06:04.193521476 +0000 UTC m=+548.685401744" watchObservedRunningTime="2026-09-07 23:06:04.19591245 +0000 UTC m=+548.687792804" Sep 07 23:06:05.427028 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.426952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:05.529704 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.528891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:05.564642 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.564596 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-2jksg"] Sep 07 23:06:05.571172 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.570126 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:05.574096 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.574071 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bpqrs\"" Sep 07 23:06:05.590134 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.584952 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-2jksg"] Sep 07 23:06:05.590365 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.585776 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 07 23:06:05.594877 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.594845 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-qljtx"] Sep 07 23:06:05.598984 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.598961 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:05.627720 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.626454 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tnz76\"" Sep 07 23:06:05.643761 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.630801 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 07 23:06:05.643761 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.639928 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:05.655062 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.655025 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-qljtx"] Sep 07 23:06:05.673963 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.673926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efcb5f3-1019-4f50-94f5-106832f9a5d0-cert\") pod \"llmisvc-controller-manager-7d548556bc-2jksg\" (UID: \"5efcb5f3-1019-4f50-94f5-106832f9a5d0\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:05.674202 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.674182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krxgf\" (UniqueName: \"kubernetes.io/projected/5efcb5f3-1019-4f50-94f5-106832f9a5d0-kube-api-access-krxgf\") pod \"llmisvc-controller-manager-7d548556bc-2jksg\" (UID: \"5efcb5f3-1019-4f50-94f5-106832f9a5d0\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:05.775167 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.775050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/816ea300-74e8-4b4c-851e-5e34332ad04a-tls-certs\") pod \"model-serving-api-7d6487fcc8-qljtx\" (UID: \"816ea300-74e8-4b4c-851e-5e34332ad04a\") " pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:05.775363 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.775169 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wj8l\" (UniqueName: \"kubernetes.io/projected/816ea300-74e8-4b4c-851e-5e34332ad04a-kube-api-access-4wj8l\") pod \"model-serving-api-7d6487fcc8-qljtx\" (UID: \"816ea300-74e8-4b4c-851e-5e34332ad04a\") " pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:05.775363 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.775210 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efcb5f3-1019-4f50-94f5-106832f9a5d0-cert\") pod \"llmisvc-controller-manager-7d548556bc-2jksg\" (UID: \"5efcb5f3-1019-4f50-94f5-106832f9a5d0\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:05.775363 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.775240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krxgf\" (UniqueName: \"kubernetes.io/projected/5efcb5f3-1019-4f50-94f5-106832f9a5d0-kube-api-access-krxgf\") pod \"llmisvc-controller-manager-7d548556bc-2jksg\" (UID: \"5efcb5f3-1019-4f50-94f5-106832f9a5d0\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:05.775541 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:06:05.775382 2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 07 23:06:05.775541 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:06:05.775479 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5efcb5f3-1019-4f50-94f5-106832f9a5d0-cert podName:5efcb5f3-1019-4f50-94f5-106832f9a5d0 nodeName:}" failed. No retries permitted until 2026-09-07 23:06:06.2754548 +0000 UTC m=+550.767335045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5efcb5f3-1019-4f50-94f5-106832f9a5d0-cert") pod "llmisvc-controller-manager-7d548556bc-2jksg" (UID: "5efcb5f3-1019-4f50-94f5-106832f9a5d0") : secret "llmisvc-webhook-server-cert" not found Sep 07 23:06:05.781214 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.781163 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:05.797739 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.797666 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krxgf\" (UniqueName: \"kubernetes.io/projected/5efcb5f3-1019-4f50-94f5-106832f9a5d0-kube-api-access-krxgf\") pod \"llmisvc-controller-manager-7d548556bc-2jksg\" (UID: \"5efcb5f3-1019-4f50-94f5-106832f9a5d0\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:05.875936 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.875897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wj8l\" (UniqueName: \"kubernetes.io/projected/816ea300-74e8-4b4c-851e-5e34332ad04a-kube-api-access-4wj8l\") pod \"model-serving-api-7d6487fcc8-qljtx\" (UID: \"816ea300-74e8-4b4c-851e-5e34332ad04a\") " pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:05.876114 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.876006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/816ea300-74e8-4b4c-851e-5e34332ad04a-tls-certs\") pod \"model-serving-api-7d6487fcc8-qljtx\" (UID: \"816ea300-74e8-4b4c-851e-5e34332ad04a\") " pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:05.876198 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:06:05.876116 2575 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 07 23:06:05.876198 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:06:05.876175 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/816ea300-74e8-4b4c-851e-5e34332ad04a-tls-certs podName:816ea300-74e8-4b4c-851e-5e34332ad04a nodeName:}" failed. No retries permitted until 2026-09-07 23:06:06.37615705 +0000 UTC m=+550.868037282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/816ea300-74e8-4b4c-851e-5e34332ad04a-tls-certs") pod "model-serving-api-7d6487fcc8-qljtx" (UID: "816ea300-74e8-4b4c-851e-5e34332ad04a") : secret "model-serving-api-tls" not found Sep 07 23:06:05.876401 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.876369 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:05.887030 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:05.886989 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wj8l\" (UniqueName: \"kubernetes.io/projected/816ea300-74e8-4b4c-851e-5e34332ad04a-kube-api-access-4wj8l\") pod \"model-serving-api-7d6487fcc8-qljtx\" (UID: \"816ea300-74e8-4b4c-851e-5e34332ad04a\") " pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:06.169532 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.169495 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:06.256276 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.256233 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:06.280422 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.280392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efcb5f3-1019-4f50-94f5-106832f9a5d0-cert\") pod \"llmisvc-controller-manager-7d548556bc-2jksg\" (UID: \"5efcb5f3-1019-4f50-94f5-106832f9a5d0\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:06.282973 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.282948 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efcb5f3-1019-4f50-94f5-106832f9a5d0-cert\") pod \"llmisvc-controller-manager-7d548556bc-2jksg\" (UID: \"5efcb5f3-1019-4f50-94f5-106832f9a5d0\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:06.320932 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.320896 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:06.381883 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.381845 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/816ea300-74e8-4b4c-851e-5e34332ad04a-tls-certs\") pod \"model-serving-api-7d6487fcc8-qljtx\" (UID: \"816ea300-74e8-4b4c-851e-5e34332ad04a\") " pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:06.384252 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.384222 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/816ea300-74e8-4b4c-851e-5e34332ad04a-tls-certs\") pod \"model-serving-api-7d6487fcc8-qljtx\" (UID: \"816ea300-74e8-4b4c-851e-5e34332ad04a\") " pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:06.484441 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.484354 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:06.495370 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.495334 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:06.576075 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.576041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:06.583210 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.583184 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:06.683749 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.683718 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:06.740757 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.740639 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:06:06.774293 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.774269 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-2jksg"] Sep 07 23:06:06.776314 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:06:06.776293 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5efcb5f3_1019_4f50_94f5_106832f9a5d0.slice/crio-414e6808714665eb5680811e4728dc96519c5bf85582ec1197db3fc8ba78cc53 WatchSource:0}: Error finding container 414e6808714665eb5680811e4728dc96519c5bf85582ec1197db3fc8ba78cc53: Status 404 returned error can't find the container with id 414e6808714665eb5680811e4728dc96519c5bf85582ec1197db3fc8ba78cc53 Sep 07 23:06:06.846593 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:06.846571 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-qljtx"] Sep 07 23:06:06.848869 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:06:06.848840 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816ea300_74e8_4b4c_851e_5e34332ad04a.slice/crio-9d5a746e0f4a3a9f13bc88bb82cae9d9dd42faea4d965805712a9914301fc0c2 WatchSource:0}: Error finding container 9d5a746e0f4a3a9f13bc88bb82cae9d9dd42faea4d965805712a9914301fc0c2: Status 404 returned error can't find the container with id 9d5a746e0f4a3a9f13bc88bb82cae9d9dd42faea4d965805712a9914301fc0c2 Sep 07 23:06:07.196250 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:07.196215 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" event={"ID":"5efcb5f3-1019-4f50-94f5-106832f9a5d0","Type":"ContainerStarted","Data":"414e6808714665eb5680811e4728dc96519c5bf85582ec1197db3fc8ba78cc53"} Sep 07 23:06:07.197384 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:07.197359 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" event={"ID":"816ea300-74e8-4b4c-851e-5e34332ad04a","Type":"ContainerStarted","Data":"9d5a746e0f4a3a9f13bc88bb82cae9d9dd42faea4d965805712a9914301fc0c2"} Sep 07 23:06:09.209988 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:09.209953 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" event={"ID":"816ea300-74e8-4b4c-851e-5e34332ad04a","Type":"ContainerStarted","Data":"eea71b149e008effe309572ac5973df8552d3121fd52641a54985c85cfe3dc90"} Sep 07 23:06:09.210376 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:09.210091 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:09.225575 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:09.225529 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" podStartSLOduration=2.683270721 podStartE2EDuration="4.225512707s" totalImagesPullingTime="1.542241986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:06:09.223231961 +0000 UTC m=+553.715112208" watchObservedRunningTime="2026-09-07 23:06:09.225512707 +0000 UTC m=+553.717392954" Sep 07 23:06:10.218278 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:10.218242 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" event={"ID":"5efcb5f3-1019-4f50-94f5-106832f9a5d0","Type":"ContainerStarted","Data":"e3151fd481e06d9d41f25e654ab08516d54524611b4149d4cdd250ea6bc67d58"} Sep 07 23:06:10.218670 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:10.218326 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:10.237921 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:10.237869 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" podStartSLOduration=2.814875165 podStartE2EDuration="5.237853702s" totalImagesPullingTime="2.422978537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:06:10.237084778 +0000 UTC m=+554.728965025" watchObservedRunningTime="2026-09-07 23:06:10.237853702 +0000 UTC m=+554.729733950" Sep 07 23:06:15.186568 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:15.186532 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-rwzk8" Sep 07 23:06:20.222741 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:20.222681 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-7d6487fcc8-qljtx" Sep 07 23:06:41.226600 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:41.226566 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-7d548556bc-2jksg" Sep 07 23:06:55.986666 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:55.986634 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:06:55.989032 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:55.988992 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:06:57.032236 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:06:57.032199 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:10.596100 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:10.596058 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:23.691897 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:23.691843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:25.640007 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:25.639968 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:30.040063 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:30.040018 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:30.088403 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:30.088359 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:30.181073 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:30.181036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:30.786001 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:30.785956 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:40.873097 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:40.873056 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:40.973659 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:40.973624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:41.029007 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:41.028972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:49.665199 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:49.665167 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:07:49.713135 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:07:49.713095 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:09:18.747547 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:09:18.747508 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:10:21.091819 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:10:21.091781 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:11:33.272495 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:11:33.272455 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:11:56.023246 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:11:56.023212 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:11:56.026361 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:11:56.026337 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:12:30.426555 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:12:30.426518 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:15:00.140830 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:00.140748 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr"] Sep 07 23:15:00.144327 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:00.144302 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" Sep 07 23:15:00.146579 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:00.146555 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pjlz2\"" Sep 07 23:15:00.155089 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:00.155059 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr"] Sep 07 23:15:00.155237 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:00.155096 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" Sep 07 23:15:00.424977 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:00.424922 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr"] Sep 07 23:15:00.431081 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:00.431059 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 23:15:00.839802 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:00.839711 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" event={"ID":"9d8fea90-2d88-462b-851b-92ee0536bc7d","Type":"ContainerStarted","Data":"3333b4435e325e1094f3dd1e2c4c40dee01bcc913974b5e4cc834743fd7b70f0"} Sep 07 23:15:03.858633 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:03.858549 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" event={"ID":"9d8fea90-2d88-462b-851b-92ee0536bc7d","Type":"ContainerStarted","Data":"a2f6e709fd8412aff927b4803f0bbf8c882dd18d2cc2b3753146edc5b645cff9"} Sep 07 23:15:03.873356 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:03.873307 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" podStartSLOduration=1.034469273 podStartE2EDuration="3.873293006s" totalImagesPullingTime="2.838823733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:15:03.871708392 +0000 UTC m=+1088.363588639" watchObservedRunningTime="2026-09-07 23:15:03.873293006 +0000 UTC m=+1088.365173252" Sep 07 23:15:04.865244 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:04.865208 2575 generic.go:356] "Generic (PLEG): container finished" podID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerID="a2f6e709fd8412aff927b4803f0bbf8c882dd18d2cc2b3753146edc5b645cff9" exitCode=7 Sep 07 23:15:04.865679 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:04.865296 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" event={"ID":"9d8fea90-2d88-462b-851b-92ee0536bc7d","Type":"ContainerDied","Data":"a2f6e709fd8412aff927b4803f0bbf8c882dd18d2cc2b3753146edc5b645cff9"} Sep 07 23:15:04.865679 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:04.865420 2575 scope.go:117] "RemoveContainer" containerID="a2f6e709fd8412aff927b4803f0bbf8c882dd18d2cc2b3753146edc5b645cff9" Sep 07 23:15:05.871578 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:05.871478 2575 generic.go:356] "Generic (PLEG): container finished" podID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerID="8feb52f89a88fe4a65976932389a66595f28583e64fe8d503cf2bf08bea1faa4" exitCode=7 Sep 07 23:15:05.871578 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:05.871567 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" event={"ID":"9d8fea90-2d88-462b-851b-92ee0536bc7d","Type":"ContainerDied","Data":"8feb52f89a88fe4a65976932389a66595f28583e64fe8d503cf2bf08bea1faa4"} Sep 07 23:15:05.872104 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:05.871617 2575 scope.go:117] "RemoveContainer" containerID="a2f6e709fd8412aff927b4803f0bbf8c882dd18d2cc2b3753146edc5b645cff9" Sep 07 23:15:05.872104 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:05.871848 2575 scope.go:117] "RemoveContainer" containerID="8feb52f89a88fe4a65976932389a66595f28583e64fe8d503cf2bf08bea1faa4" Sep 07 23:15:05.872275 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:15:05.872159 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29813715-qz8gr_odh-ai-gateway-infra(9d8fea90-2d88-462b-851b-92ee0536bc7d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" Sep 07 23:15:06.877944 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:06.877917 2575 scope.go:117] "RemoveContainer" containerID="8feb52f89a88fe4a65976932389a66595f28583e64fe8d503cf2bf08bea1faa4" Sep 07 23:15:06.878304 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:15:06.878140 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29813715-qz8gr_odh-ai-gateway-infra(9d8fea90-2d88-462b-851b-92ee0536bc7d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" Sep 07 23:15:22.031496 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:22.031468 2575 scope.go:117] "RemoveContainer" containerID="8feb52f89a88fe4a65976932389a66595f28583e64fe8d503cf2bf08bea1faa4" Sep 07 23:15:22.969357 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:22.969322 2575 generic.go:356] "Generic (PLEG): container finished" podID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerID="2a86b06d2f308727539d2ec91572d32e574af87fc31fa823d080c7b9fb9ea693" exitCode=7 Sep 07 23:15:22.969537 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:22.969394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" event={"ID":"9d8fea90-2d88-462b-851b-92ee0536bc7d","Type":"ContainerDied","Data":"2a86b06d2f308727539d2ec91572d32e574af87fc31fa823d080c7b9fb9ea693"} Sep 07 23:15:22.969537 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:22.969455 2575 scope.go:117] "RemoveContainer" containerID="8feb52f89a88fe4a65976932389a66595f28583e64fe8d503cf2bf08bea1faa4" Sep 07 23:15:22.969750 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:22.969727 2575 scope.go:117] "RemoveContainer" containerID="2a86b06d2f308727539d2ec91572d32e574af87fc31fa823d080c7b9fb9ea693" Sep 07 23:15:22.969988 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:15:22.969968 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29813715-qz8gr_odh-ai-gateway-infra(9d8fea90-2d88-462b-851b-92ee0536bc7d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" Sep 07 23:15:23.992798 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:23.992761 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr"] Sep 07 23:15:24.129465 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:24.129438 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" Sep 07 23:15:24.981648 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:24.981614 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" Sep 07 23:15:24.981823 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:24.981657 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr" event={"ID":"9d8fea90-2d88-462b-851b-92ee0536bc7d","Type":"ContainerDied","Data":"3333b4435e325e1094f3dd1e2c4c40dee01bcc913974b5e4cc834743fd7b70f0"} Sep 07 23:15:24.981823 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:24.981756 2575 scope.go:117] "RemoveContainer" containerID="2a86b06d2f308727539d2ec91572d32e574af87fc31fa823d080c7b9fb9ea693" Sep 07 23:15:25.003578 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:25.003548 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr"] Sep 07 23:15:25.007054 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:25.007026 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813715-qz8gr"] Sep 07 23:15:26.032282 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:15:26.032247 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" path="/var/lib/kubelet/pods/9d8fea90-2d88-462b-851b-92ee0536bc7d/volumes" Sep 07 23:16:56.064513 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:16:56.064476 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:16:56.068153 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:16:56.068132 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:19:47.401104 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:19:47.401064 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:20:10.578358 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:20:10.578323 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:21:56.096050 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:21:56.096019 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:21:56.100677 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:21:56.100649 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:23:10.475093 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:23:10.475042 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:23:10.564517 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:23:10.564482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:24:27.566223 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:24:27.566184 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:25:44.514025 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:44.513986 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:25:46.107571 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:46.107529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:25:47.357990 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:47.357943 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-ggqcs"] Sep 07 23:25:47.358473 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:47.358222 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-ggqcs" podUID="a9295aae-dd19-4add-b93c-4f562dc3f0ad" containerName="authorino" containerID="cri-o://25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7" gracePeriod=30 Sep 07 23:25:47.609870 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:47.609794 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-ggqcs" Sep 07 23:25:47.780871 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:47.780835 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr5p2\" (UniqueName: \"kubernetes.io/projected/a9295aae-dd19-4add-b93c-4f562dc3f0ad-kube-api-access-qr5p2\") pod \"a9295aae-dd19-4add-b93c-4f562dc3f0ad\" (UID: \"a9295aae-dd19-4add-b93c-4f562dc3f0ad\") " Sep 07 23:25:47.782874 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:47.782853 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9295aae-dd19-4add-b93c-4f562dc3f0ad-kube-api-access-qr5p2" (OuterVolumeSpecName: "kube-api-access-qr5p2") pod "a9295aae-dd19-4add-b93c-4f562dc3f0ad" (UID: "a9295aae-dd19-4add-b93c-4f562dc3f0ad"). InnerVolumeSpecName "kube-api-access-qr5p2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 23:25:47.882109 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:47.882009 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr5p2\" (UniqueName: \"kubernetes.io/projected/a9295aae-dd19-4add-b93c-4f562dc3f0ad-kube-api-access-qr5p2\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\"" Sep 07 23:25:48.103548 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:48.103508 2575 generic.go:356] "Generic (PLEG): container finished" podID="a9295aae-dd19-4add-b93c-4f562dc3f0ad" containerID="25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7" exitCode=0 Sep 07 23:25:48.103775 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:48.103561 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-ggqcs" event={"ID":"a9295aae-dd19-4add-b93c-4f562dc3f0ad","Type":"ContainerDied","Data":"25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7"} Sep 07 23:25:48.103775 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:48.103579 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-ggqcs" Sep 07 23:25:48.103775 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:48.103600 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-ggqcs" event={"ID":"a9295aae-dd19-4add-b93c-4f562dc3f0ad","Type":"ContainerDied","Data":"b584877bca525bd1bd91c8b31de0b5be35ac8da846412ca73268b6eab9733dfe"} Sep 07 23:25:48.103775 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:48.103621 2575 scope.go:117] "RemoveContainer" containerID="25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7" Sep 07 23:25:48.112256 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:48.112232 2575 scope.go:117] "RemoveContainer" containerID="25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7" Sep 07 23:25:48.112541 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:25:48.112522 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7\": container with ID starting with 25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7 not found: ID does not exist" containerID="25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7" Sep 07 23:25:48.112589 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:48.112551 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7"} err="failed to get container status \"25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7\": rpc error: code = NotFound desc = could not find container \"25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7\": container with ID starting with 25d40f3352aea78a2de006c52425b13b9301816e9c6ffbb33de6c4957dc585f7 not found: ID does not exist" Sep 07 23:25:48.118388 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:48.118354 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-ggqcs"] Sep 07 23:25:48.121330 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:48.121306 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-ggqcs"] Sep 07 23:25:50.031924 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:25:50.031884 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9295aae-dd19-4add-b93c-4f562dc3f0ad" path="/var/lib/kubelet/pods/a9295aae-dd19-4add-b93c-4f562dc3f0ad/volumes" Sep 07 23:26:56.128925 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:26:56.128887 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:26:56.134342 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:26:56.134318 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:30:00.143740 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.143617 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd"] Sep 07 23:30:00.144320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.144043 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9295aae-dd19-4add-b93c-4f562dc3f0ad" containerName="authorino" Sep 07 23:30:00.144320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.144056 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9295aae-dd19-4add-b93c-4f562dc3f0ad" containerName="authorino" Sep 07 23:30:00.144320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.144086 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerName="cleanup" Sep 07 23:30:00.144320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.144092 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerName="cleanup" Sep 07 23:30:00.144320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.144118 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerName="cleanup" Sep 07 23:30:00.144320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.144125 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerName="cleanup" Sep 07 23:30:00.144320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.144201 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerName="cleanup" Sep 07 23:30:00.144320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.144211 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9295aae-dd19-4add-b93c-4f562dc3f0ad" containerName="authorino" Sep 07 23:30:00.144320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.144218 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerName="cleanup" Sep 07 23:30:00.144320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.144224 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerName="cleanup" Sep 07 23:30:00.147471 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.147452 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" Sep 07 23:30:00.149618 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.149586 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pjlz2\"" Sep 07 23:30:00.154028 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.154001 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd"] Sep 07 23:30:00.159320 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.159300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" Sep 07 23:30:00.432024 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:00.431994 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd"] Sep 07 23:30:00.434560 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:30:00.434533 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb258daaa_84e9_463f_9727_92be85529902.slice/crio-dc4264d37d98fdf809c9ff25f04643d514ba5ac397ddfa6c8ab669e8e4adf776 WatchSource:0}: Error finding container dc4264d37d98fdf809c9ff25f04643d514ba5ac397ddfa6c8ab669e8e4adf776: Status 404 returned error can't find the container with id dc4264d37d98fdf809c9ff25f04643d514ba5ac397ddfa6c8ab669e8e4adf776 Sep 07 23:30:01.356011 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:01.355976 2575 generic.go:356] "Generic (PLEG): container finished" podID="b258daaa-84e9-463f-9727-92be85529902" containerID="d496900cf51558ec30a9222235664dcb5687c78e07dc0cf26892f4ed8b219d7c" exitCode=7 Sep 07 23:30:01.356405 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:01.356063 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" event={"ID":"b258daaa-84e9-463f-9727-92be85529902","Type":"ContainerDied","Data":"d496900cf51558ec30a9222235664dcb5687c78e07dc0cf26892f4ed8b219d7c"} Sep 07 23:30:01.356405 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:01.356116 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" event={"ID":"b258daaa-84e9-463f-9727-92be85529902","Type":"ContainerStarted","Data":"dc4264d37d98fdf809c9ff25f04643d514ba5ac397ddfa6c8ab669e8e4adf776"} Sep 07 23:30:01.356405 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:01.356202 2575 scope.go:117] "RemoveContainer" containerID="d496900cf51558ec30a9222235664dcb5687c78e07dc0cf26892f4ed8b219d7c" Sep 07 23:30:02.363370 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:02.363268 2575 generic.go:356] "Generic (PLEG): container finished" podID="b258daaa-84e9-463f-9727-92be85529902" containerID="3105cccc61a41ae533582094067c0f4ad659af5d81a7f6e28aaa5166f61887f3" exitCode=7 Sep 07 23:30:02.363370 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:02.363350 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" event={"ID":"b258daaa-84e9-463f-9727-92be85529902","Type":"ContainerDied","Data":"3105cccc61a41ae533582094067c0f4ad659af5d81a7f6e28aaa5166f61887f3"} Sep 07 23:30:02.363903 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:02.363412 2575 scope.go:117] "RemoveContainer" containerID="d496900cf51558ec30a9222235664dcb5687c78e07dc0cf26892f4ed8b219d7c" Sep 07 23:30:02.363903 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:02.363651 2575 scope.go:117] "RemoveContainer" containerID="3105cccc61a41ae533582094067c0f4ad659af5d81a7f6e28aaa5166f61887f3" Sep 07 23:30:02.363981 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:30:02.363917 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29813730-qpqtd_odh-ai-gateway-infra(b258daaa-84e9-463f-9727-92be85529902)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" podUID="b258daaa-84e9-463f-9727-92be85529902" Sep 07 23:30:03.369972 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:03.369938 2575 scope.go:117] "RemoveContainer" containerID="3105cccc61a41ae533582094067c0f4ad659af5d81a7f6e28aaa5166f61887f3" Sep 07 23:30:03.370475 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:30:03.370171 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29813730-qpqtd_odh-ai-gateway-infra(b258daaa-84e9-463f-9727-92be85529902)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" podUID="b258daaa-84e9-463f-9727-92be85529902" Sep 07 23:30:14.032166 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:14.032129 2575 scope.go:117] "RemoveContainer" containerID="3105cccc61a41ae533582094067c0f4ad659af5d81a7f6e28aaa5166f61887f3" Sep 07 23:30:14.426727 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:14.426674 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" event={"ID":"b258daaa-84e9-463f-9727-92be85529902","Type":"ContainerStarted","Data":"4245abc20998e51fef200970a102655fb507212b2f434dac534deaec0b3990d3"} Sep 07 23:30:14.442976 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:14.442923 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" podStartSLOduration=14.442906168 podStartE2EDuration="14.442906168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:30:14.441442865 +0000 UTC m=+1998.933323111" watchObservedRunningTime="2026-09-07 23:30:14.442906168 +0000 UTC m=+1998.934786414" Sep 07 23:30:15.433537 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:15.433505 2575 generic.go:356] "Generic (PLEG): container finished" podID="b258daaa-84e9-463f-9727-92be85529902" containerID="4245abc20998e51fef200970a102655fb507212b2f434dac534deaec0b3990d3" exitCode=7 Sep 07 23:30:15.433991 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:15.433576 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" event={"ID":"b258daaa-84e9-463f-9727-92be85529902","Type":"ContainerDied","Data":"4245abc20998e51fef200970a102655fb507212b2f434dac534deaec0b3990d3"} Sep 07 23:30:15.433991 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:15.433636 2575 scope.go:117] "RemoveContainer" containerID="3105cccc61a41ae533582094067c0f4ad659af5d81a7f6e28aaa5166f61887f3" Sep 07 23:30:15.433991 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:15.433896 2575 scope.go:117] "RemoveContainer" containerID="4245abc20998e51fef200970a102655fb507212b2f434dac534deaec0b3990d3" Sep 07 23:30:15.434186 ip-10-0-136-182 kubenswrapper[2575]: E0907 23:30:15.434132 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29813730-qpqtd_odh-ai-gateway-infra(b258daaa-84e9-463f-9727-92be85529902)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" podUID="b258daaa-84e9-463f-9727-92be85529902" Sep 07 23:30:15.457413 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:15.457381 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd"] Sep 07 23:30:16.576821 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:16.576776 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" Sep 07 23:30:17.445870 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:17.445835 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" event={"ID":"b258daaa-84e9-463f-9727-92be85529902","Type":"ContainerDied","Data":"dc4264d37d98fdf809c9ff25f04643d514ba5ac397ddfa6c8ab669e8e4adf776"} Sep 07 23:30:17.446031 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:17.445875 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd" Sep 07 23:30:17.446031 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:17.445897 2575 scope.go:117] "RemoveContainer" containerID="4245abc20998e51fef200970a102655fb507212b2f434dac534deaec0b3990d3" Sep 07 23:30:17.466207 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:17.466176 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd"] Sep 07 23:30:17.469767 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:17.469740 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813730-qpqtd"] Sep 07 23:30:18.032195 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:30:18.032162 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b258daaa-84e9-463f-9727-92be85529902" path="/var/lib/kubelet/pods/b258daaa-84e9-463f-9727-92be85529902/volumes" Sep 07 23:31:00.991705 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:31:00.991644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:31:02.102592 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:31:02.102552 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:31:56.161367 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:31:56.161341 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:31:56.166720 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:31:56.166683 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:35:53.651741 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:35:53.651651 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-hrrxd_e627a03b-e75e-4336-aaf4-5c50ecc46a45/manager/0.log" Sep 07 23:35:53.761573 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:35:53.761535 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-7d548556bc-2jksg_5efcb5f3-1019-4f50-94f5-106832f9a5d0/manager/0.log" Sep 07 23:35:53.985041 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:35:53.984963 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-7d6487fcc8-qljtx_816ea300-74e8-4b4c-851e-5e34332ad04a/server/0.log" Sep 07 23:35:55.724509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:35:55.724480 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-vn7df_0819d0df-4d9f-42a9-88f4-cda4c0da63ed/kuadrant-console-plugin/0.log" Sep 07 23:35:55.935802 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:35:55.935764 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-bnv69_653a5b44-54fb-4458-b21e-052e1b967d55/limitador/0.log" Sep 07 23:35:56.704194 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:35:56.704162 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6db477577b-jds9b_882d7ef3-9029-4826-81ce-5e1e99dd6a92/kube-auth-proxy/0.log" Sep 07 23:35:57.038092 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:35:57.038012 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-rwzk8_3ad6ac05-1808-4697-9d46-93235e17e22f/payload-processing/0.log" Sep 07 23:36:02.721423 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:02.721388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:36:03.722847 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:03.722813 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" limit=1024 Sep 07 23:36:05.515035 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:05.515005 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sxc47_2e425f64-f9af-4fdf-843f-56276b8636b2/global-pull-secret-syncer/0.log" Sep 07 23:36:05.562930 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:05.562892 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9brr9_15cc854b-4d68-43a7-8e8a-67e9c54899ea/konnectivity-agent/0.log" Sep 07 23:36:05.653905 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:05.653873 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-182.ec2.internal_90a54d7775c37a0a8fb3d83f660006a3/haproxy/0.log" Sep 07 23:36:10.420541 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:10.420508 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-vn7df_0819d0df-4d9f-42a9-88f4-cda4c0da63ed/kuadrant-console-plugin/0.log" Sep 07 23:36:10.469008 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:10.468978 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-bnv69_653a5b44-54fb-4458-b21e-052e1b967d55/limitador/0.log" Sep 07 23:36:12.115045 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.115003 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-27pzn_33c7561a-c7ee-4e37-836f-2b3623d89c25/cluster-monitoring-operator/0.log" Sep 07 23:36:12.138365 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.138322 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pmvhh_62884f84-f367-413d-a549-55419cb24d1e/kube-state-metrics/0.log" Sep 07 23:36:12.158282 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.158236 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pmvhh_62884f84-f367-413d-a549-55419cb24d1e/kube-rbac-proxy-main/0.log" Sep 07 23:36:12.174373 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.174346 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pmvhh_62884f84-f367-413d-a549-55419cb24d1e/kube-rbac-proxy-self/0.log" Sep 07 23:36:12.232290 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.232260 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-cpcnd_75fd45f0-6414-4af6-bf40-062005dbbdfc/monitoring-plugin/0.log" Sep 07 23:36:12.259509 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.259475 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mqmlh_eeba437e-e242-4872-9520-477ba14443b6/node-exporter/0.log" Sep 07 23:36:12.281244 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.281217 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mqmlh_eeba437e-e242-4872-9520-477ba14443b6/kube-rbac-proxy/0.log" Sep 07 23:36:12.299001 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.298973 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mqmlh_eeba437e-e242-4872-9520-477ba14443b6/init-textfile/0.log" Sep 07 23:36:12.481428 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.481393 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qk96j_1df7ee00-4b40-41eb-b96d-43677ed257c9/kube-rbac-proxy-main/0.log" Sep 07 23:36:12.505244 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.505208 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qk96j_1df7ee00-4b40-41eb-b96d-43677ed257c9/kube-rbac-proxy-self/0.log" Sep 07 23:36:12.526212 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.526176 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qk96j_1df7ee00-4b40-41eb-b96d-43677ed257c9/openshift-state-metrics/0.log" Sep 07 23:36:12.567365 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.567340 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93c1360c-4244-48f1-b531-e773ad3ce70d/prometheus/0.log" Sep 07 23:36:12.593280 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.593251 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93c1360c-4244-48f1-b531-e773ad3ce70d/config-reloader/0.log" Sep 07 23:36:12.615596 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.615572 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93c1360c-4244-48f1-b531-e773ad3ce70d/thanos-sidecar/0.log" Sep 07 23:36:12.639468 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.639434 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93c1360c-4244-48f1-b531-e773ad3ce70d/kube-rbac-proxy-web/0.log" Sep 07 23:36:12.658901 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.658869 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93c1360c-4244-48f1-b531-e773ad3ce70d/kube-rbac-proxy/0.log" Sep 07 23:36:12.678171 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.678144 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93c1360c-4244-48f1-b531-e773ad3ce70d/kube-rbac-proxy-thanos/0.log" Sep 07 23:36:12.696984 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.696908 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93c1360c-4244-48f1-b531-e773ad3ce70d/init-config-reloader/0.log" Sep 07 23:36:12.784289 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.784265 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-hh4l4_d09e97fd-3d1c-4d35-b8f5-b8794f86430d/prometheus-operator-admission-webhook/0.log" Sep 07 23:36:12.812351 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.812323 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-764547cb79-vkhr6_e741e6b2-37ce-48c8-9ade-cbb8887b3f50/telemeter-client/0.log" Sep 07 23:36:12.830656 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.830632 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-764547cb79-vkhr6_e741e6b2-37ce-48c8-9ade-cbb8887b3f50/reload/0.log" Sep 07 23:36:12.848744 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:12.848720 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-764547cb79-vkhr6_e741e6b2-37ce-48c8-9ade-cbb8887b3f50/kube-rbac-proxy/0.log" Sep 07 23:36:15.208562 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.208521 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd"] Sep 07 23:36:15.208973 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.208957 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerName="cleanup" Sep 07 23:36:15.209017 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.208976 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8fea90-2d88-462b-851b-92ee0536bc7d" containerName="cleanup" Sep 07 23:36:15.209017 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.208993 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b258daaa-84e9-463f-9727-92be85529902" containerName="cleanup" Sep 07 23:36:15.209017 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.208999 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b258daaa-84e9-463f-9727-92be85529902" containerName="cleanup" Sep 07 23:36:15.209017 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.209005 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b258daaa-84e9-463f-9727-92be85529902" containerName="cleanup" Sep 07 23:36:15.209017 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.209010 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b258daaa-84e9-463f-9727-92be85529902" containerName="cleanup" Sep 07 23:36:15.209170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.209023 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b258daaa-84e9-463f-9727-92be85529902" containerName="cleanup" Sep 07 23:36:15.209170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.209029 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b258daaa-84e9-463f-9727-92be85529902" containerName="cleanup" Sep 07 23:36:15.209170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.209102 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b258daaa-84e9-463f-9727-92be85529902" containerName="cleanup" Sep 07 23:36:15.209170 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.209113 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b258daaa-84e9-463f-9727-92be85529902" containerName="cleanup" Sep 07 23:36:15.212421 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.212399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.214444 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.214417 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p6296\"/\"default-dockercfg-qqdml\"" Sep 07 23:36:15.214558 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.214466 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p6296\"/\"openshift-service-ca.crt\"" Sep 07 23:36:15.215239 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.215221 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p6296\"/\"kube-root-ca.crt\"" Sep 07 23:36:15.217873 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.217853 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd"] Sep 07 23:36:15.272003 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.271971 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-podres\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.272003 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.272006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-sys\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.272225 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.272034 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-lib-modules\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.272225 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.272147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s68b\" (UniqueName: \"kubernetes.io/projected/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-kube-api-access-5s68b\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.272225 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.272180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-proc\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.372605 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.372554 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-proc\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.372843 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.372636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-podres\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.372843 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.372670 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-sys\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.372843 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.372730 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-proc\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.372843 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.372749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-lib-modules\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.372843 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.372797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-podres\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.372843 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.372814 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-sys\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.373142 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.372859 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-lib-modules\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.373142 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.372879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s68b\" (UniqueName: \"kubernetes.io/projected/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-kube-api-access-5s68b\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.380240 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.380216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s68b\" (UniqueName: \"kubernetes.io/projected/c5367ff3-df3a-4c1b-b7ec-fe6eca420592-kube-api-access-5s68b\") pod \"perf-node-gather-daemonset-57rhd\" (UID: \"c5367ff3-df3a-4c1b-b7ec-fe6eca420592\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.524486 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.524389 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:15.796410 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:15.796382 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd"] Sep 07 23:36:15.799086 ip-10-0-136-182 kubenswrapper[2575]: W0907 23:36:15.799046 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc5367ff3_df3a_4c1b_b7ec_fe6eca420592.slice/crio-2ae6e0122ac3db21af7ad100d84db755e5785759570fff5bec10512486262d54 WatchSource:0}: Error finding container 2ae6e0122ac3db21af7ad100d84db755e5785759570fff5bec10512486262d54: Status 404 returned error can't find the container with id 2ae6e0122ac3db21af7ad100d84db755e5785759570fff5bec10512486262d54 Sep 07 23:36:16.179289 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:16.179260 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-8l2gp_b58284b9-6b8b-4654-903e-18625b2eae39/volume-data-source-validator/0.log" Sep 07 23:36:16.221301 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:16.221259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" event={"ID":"c5367ff3-df3a-4c1b-b7ec-fe6eca420592","Type":"ContainerStarted","Data":"3dbd058575fb838787588e21040425da47725b02ebe0c0efc01b5143fddd9089"} Sep 07 23:36:16.221714 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:16.221320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" event={"ID":"c5367ff3-df3a-4c1b-b7ec-fe6eca420592","Type":"ContainerStarted","Data":"2ae6e0122ac3db21af7ad100d84db755e5785759570fff5bec10512486262d54"} Sep 07 23:36:16.221714 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:16.221455 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:16.234834 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:16.234679 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" podStartSLOduration=1.234663018 podStartE2EDuration="1.234663018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 23:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:36:16.23398048 +0000 UTC m=+2360.725860738" watchObservedRunningTime="2026-09-07 23:36:16.234663018 +0000 UTC m=+2360.726543266" Sep 07 23:36:17.179300 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:17.179270 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tqhmh_dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb/dns/0.log" Sep 07 23:36:17.196799 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:17.196774 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tqhmh_dacb9145-5d8f-4fa5-8f7a-ac2ff0ca5bdb/kube-rbac-proxy/0.log" Sep 07 23:36:17.238926 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:17.238881 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dznnd_cd75c66f-215a-4eb3-b9aa-ae24f452593b/dns-node-resolver/0.log" Sep 07 23:36:17.801794 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:17.801757 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jzfnw_da3011ac-9e6b-4594-9704-ae1167d64bea/node-ca/0.log" Sep 07 23:36:18.738737 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:18.738679 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6db477577b-jds9b_882d7ef3-9029-4826-81ce-5e1e99dd6a92/kube-auth-proxy/0.log" Sep 07 23:36:18.808077 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:18.808035 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-rwzk8_3ad6ac05-1808-4697-9d46-93235e17e22f/payload-processing/0.log" Sep 07 23:36:19.431614 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:19.431555 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-svx9r_925932eb-71e5-4bae-a747-41d27840279c/serve-healthcheck-canary/0.log" Sep 07 23:36:19.900766 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:19.900700 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-fft2n_91e24119-3c8f-4d2b-90a2-15065f0002cf/insights-operator/0.log" Sep 07 23:36:19.902226 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:19.902197 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-fft2n_91e24119-3c8f-4d2b-90a2-15065f0002cf/insights-operator/1.log" Sep 07 23:36:19.978872 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:19.978842 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcfdw_76ca2144-5f97-433b-a453-38003496f82a/kube-rbac-proxy/0.log" Sep 07 23:36:19.996268 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:19.996243 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcfdw_76ca2144-5f97-433b-a453-38003496f82a/exporter/0.log" Sep 07 23:36:20.015817 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:20.015771 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcfdw_76ca2144-5f97-433b-a453-38003496f82a/extractor/0.log" Sep 07 23:36:22.204229 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:22.204202 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6f7668fc86-pwcn2_637c395c-d6dc-4459-9715-1a49e650b436/manager/0.log" Sep 07 23:36:22.220959 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:22.220936 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6f7668fc86-pwcn2_637c395c-d6dc-4459-9715-1a49e650b436/copy-manifests/0.log" Sep 07 23:36:22.236060 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:22.236032 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-57rhd" Sep 07 23:36:23.300824 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:23.300792 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-56d489b4b8-l28jf_e5db2eab-7866-45af-9bbe-305dca89e0b8/jobset-operator/0.log" Sep 07 23:36:23.882445 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:23.882416 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-hrrxd_e627a03b-e75e-4336-aaf4-5c50ecc46a45/manager/0.log" Sep 07 23:36:23.900222 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:23.900191 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-7d548556bc-2jksg_5efcb5f3-1019-4f50-94f5-106832f9a5d0/manager/0.log" Sep 07 23:36:23.954465 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:23.954438 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-7d6487fcc8-qljtx_816ea300-74e8-4b4c-851e-5e34332ad04a/server/0.log" Sep 07 23:36:24.015803 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:24.015771 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6db477577b-jds9b_882d7ef3-9029-4826-81ce-5e1e99dd6a92/kube-auth-proxy/0.log" Sep 07 23:36:24.061755 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:24.061723 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-rwzk8_3ad6ac05-1808-4697-9d46-93235e17e22f/payload-processing/0.log" Sep 07 23:36:25.223674 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:25.223654 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6db477577b-jds9b_882d7ef3-9029-4826-81ce-5e1e99dd6a92/kube-auth-proxy/0.log" Sep 07 23:36:25.269548 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:25.269526 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-rwzk8_3ad6ac05-1808-4697-9d46-93235e17e22f/payload-processing/0.log" Sep 07 23:36:29.263961 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:29.263929 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-l95qb_64e41cdc-3030-478d-bce9-e6f5121c9dc8/kube-storage-version-migrator-operator/1.log" Sep 07 23:36:29.264950 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:29.264925 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-l95qb_64e41cdc-3030-478d-bce9-e6f5121c9dc8/kube-storage-version-migrator-operator/0.log" Sep 07 23:36:30.257231 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:30.257202 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6x26b_6ca63b76-d100-4440-a8fb-0542e88abae0/kube-multus/0.log" Sep 07 23:36:30.276813 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:30.276785 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-26njv_a517455b-ea8b-4c95-bf94-1c4b037603e5/kube-multus-additional-cni-plugins/0.log" Sep 07 23:36:30.295674 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:30.295650 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-26njv_a517455b-ea8b-4c95-bf94-1c4b037603e5/egress-router-binary-copy/0.log" Sep 07 23:36:30.313984 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:30.313955 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-26njv_a517455b-ea8b-4c95-bf94-1c4b037603e5/cni-plugins/0.log" Sep 07 23:36:30.331405 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:30.331376 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-26njv_a517455b-ea8b-4c95-bf94-1c4b037603e5/bond-cni-plugin/0.log" Sep 07 23:36:30.349519 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:30.349496 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-26njv_a517455b-ea8b-4c95-bf94-1c4b037603e5/routeoverride-cni/0.log" Sep 07 23:36:30.367146 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:30.367119 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-26njv_a517455b-ea8b-4c95-bf94-1c4b037603e5/whereabouts-cni-bincopy/0.log" Sep 07 23:36:30.384220 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:30.384199 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-26njv_a517455b-ea8b-4c95-bf94-1c4b037603e5/whereabouts-cni/0.log" Sep 07 23:36:30.800520 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:30.800490 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-drkv2_25fa86da-a99d-4924-9a7a-7cb993ac385c/network-metrics-daemon/0.log" Sep 07 23:36:30.817026 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:30.816998 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-drkv2_25fa86da-a99d-4924-9a7a-7cb993ac385c/kube-rbac-proxy/0.log" Sep 07 23:36:31.753186 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:31.753154 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-controller/0.log" Sep 07 23:36:31.767836 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:31.767785 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/1.log" Sep 07 23:36:31.767836 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:31.767810 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovn-acl-logging/0.log" Sep 07 23:36:31.788396 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:31.788359 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/kube-rbac-proxy-node/0.log" Sep 07 23:36:31.806234 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:31.806203 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 23:36:31.820929 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:31.820905 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/northd/0.log" Sep 07 23:36:31.839032 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:31.839010 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/nbdb/0.log" Sep 07 23:36:31.855955 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:31.855926 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/sbdb/0.log" Sep 07 23:36:31.889804 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:31.889777 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hvc7g_a3c58869-07cd-4220-8186-31b4f2bc256c/ovnkube-controller/0.log" Sep 07 23:36:33.036806 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:33.036775 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-h949s_a24aa2cf-f380-4dcf-9f2e-837be2f314a3/check-endpoints/0.log" Sep 07 23:36:33.058081 ip-10-0-136-182 kubenswrapper[2575]: I0907 23:36:33.058050 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4gstr_31974305-b5bf-4206-855b-9a084b70a681/network-check-target-container/0.log"