Sep 18 13:19:09.012056 ip-10-0-129-232 systemd[1]: Starting Kubernetes Kubelet... Sep 18 13:19:12.446170 ip-10-0-129-232 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:19:12.446170 ip-10-0-129-232 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 13:19:12.446170 ip-10-0-129-232 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:19:12.446170 ip-10-0-129-232 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 13:19:12.446170 ip-10-0-129-232 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:19:12.447191 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.446254 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 13:19:12.450585 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450560 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:19:12.450585 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450580 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:19:12.450585 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450584 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:19:12.450585 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450587 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:19:12.450585 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450590 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:19:12.450585 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450593 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450596 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450600 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450603 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450606 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450609 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450612 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450615 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450618 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450621 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450626 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450630 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450633 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450636 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450639 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450642 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450645 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450647 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450650 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450658 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:19:12.450835 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450661 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450663 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450666 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450668 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450671 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450674 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450676 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450679 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450681 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450684 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450686 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450689 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450693 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450697 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450701 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450704 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450708 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450711 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450729 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:19:12.451344 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450734 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450738 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450742 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450744 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450747 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450750 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450752 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450755 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450757 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450760 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450763 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450765 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450769 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450771 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450774 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450778 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450782 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450785 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450788 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:19:12.451843 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450791 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450794 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450796 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450799 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450803 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450805 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450807 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450810 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450813 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450817 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450819 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450822 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450824 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450827 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450830 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450832 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450835 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450837 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450840 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450842 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:19:12.452311 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450846 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450848 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450851 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450853 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450856 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450859 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450862 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450865 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450867 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450870 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450872 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450875 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450877 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450880 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450883 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.450885 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451592 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451600 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451604 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:19:12.452875 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451609 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451613 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451616 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451618 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451622 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451624 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451627 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451630 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451633 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451635 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451638 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451640 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451643 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451645 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451649 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451652 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451654 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451657 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451660 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:19:12.453340 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451663 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451666 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451668 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451672 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451675 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451708 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451712 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451727 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451730 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451733 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451735 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451738 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451740 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451743 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451746 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451749 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451751 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451754 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451758 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451761 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:19:12.453866 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451763 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451766 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451769 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451771 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451774 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451777 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451779 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451782 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451785 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451788 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451791 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451794 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451796 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451799 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451802 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451804 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451807 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451809 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451812 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451815 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:19:12.454352 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451817 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451820 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451822 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451825 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451828 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451830 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451834 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451836 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451839 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451842 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451844 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451847 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451852 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451855 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451858 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451860 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451863 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451866 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451868 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451871 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:19:12.454863 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451873 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451877 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451880 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451882 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451885 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451888 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451890 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451893 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451896 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451898 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451903 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451906 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451910 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451912 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451915 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451918 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.451920 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452309 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452313 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:19:12.455371 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452316 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452319 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452322 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452325 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452328 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452331 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452334 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452337 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452340 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452343 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452345 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452348 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452351 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452353 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452356 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452359 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452362 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452364 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452368 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452370 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:19:12.455860 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452373 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452375 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452378 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452381 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452384 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452387 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452390 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452393 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452396 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452398 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452401 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452404 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452406 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452409 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452414 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452417 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452419 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452422 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452427 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:19:12.456345 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452430 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452433 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452436 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452438 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452441 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452443 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452446 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452448 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452451 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452454 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452456 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452459 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452462 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452465 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452467 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452470 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452473 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452475 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452478 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452481 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:19:12.456825 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452484 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452486 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452489 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452491 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452494 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452496 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452499 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452503 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452506 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452508 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452511 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452513 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452516 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452519 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452521 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452524 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452527 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452530 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452534 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:19:12.457355 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452536 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452539 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452542 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452544 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452547 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452550 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452553 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452555 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452558 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452560 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452563 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452565 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452568 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452570 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452573 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452575 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452578 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452580 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.452583 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452657 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452695 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 13:19:12.457832 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452704 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452708 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452726 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452729 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452734 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452738 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452741 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452745 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452748 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452752 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452755 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452758 2580 flags.go:64] FLAG: --cgroup-root="" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452761 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452764 2580 flags.go:64] FLAG: --client-ca-file="" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452767 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452771 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452777 2580 flags.go:64] FLAG: --cluster-domain="" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452780 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452784 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452787 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452790 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452794 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452797 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 13:19:12.458399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452800 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452803 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452806 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452809 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452812 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452815 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452818 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452822 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452827 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452830 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452833 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452836 2580 flags.go:64] FLAG: --enable-server="true" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452839 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452843 2580 flags.go:64] FLAG: --event-burst="100" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452846 2580 flags.go:64] FLAG: --event-qps="50" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452849 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452852 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452855 2580 flags.go:64] FLAG: --eviction-hard="" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452858 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452861 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452864 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452867 2580 flags.go:64] FLAG: --eviction-soft="" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452870 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452872 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452876 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 13:19:12.458979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452880 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452883 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452886 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452889 2580 flags.go:64] FLAG: --feature-gates="" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452893 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452896 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452899 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452902 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452905 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452907 2580 flags.go:64] FLAG: --help="false" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452910 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452914 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452917 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452920 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452923 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452928 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452931 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452934 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452936 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452940 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452943 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452946 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452949 2580 flags.go:64] FLAG: --kube-reserved="" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452951 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 13:19:12.459624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452954 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452957 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452960 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452963 2580 flags.go:64] FLAG: --lock-file="" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452965 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452968 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452971 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452976 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452981 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452984 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452987 2580 flags.go:64] FLAG: --logging-format="text" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452990 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452993 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452996 2580 flags.go:64] FLAG: --manifest-url="" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.452999 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453003 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453006 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453010 2580 flags.go:64] FLAG: --max-pods="110" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453013 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453016 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453019 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453022 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453025 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453029 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453032 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 13:19:12.460235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453039 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453042 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453045 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453048 2580 flags.go:64] FLAG: --pod-cidr="" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453051 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453056 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453059 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453062 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453065 2580 flags.go:64] FLAG: --port="10250" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453068 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453072 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c098b9427f4f358b" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453075 2580 flags.go:64] FLAG: --qos-reserved="" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453078 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453081 2580 flags.go:64] FLAG: --register-node="true" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453084 2580 flags.go:64] FLAG: --register-with-taints="" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453087 2580 flags.go:64] FLAG: --registry-burst="10" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453092 2580 flags.go:64] FLAG: --registry-qps="5" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453096 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453098 2580 flags.go:64] FLAG: --reserved-memory="" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453102 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453105 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453108 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453111 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453114 2580 flags.go:64] FLAG: --runonce="false" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453117 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 13:19:12.460866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453120 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453123 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453125 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453128 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453131 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453136 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453139 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453142 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453145 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453148 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453151 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453154 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453157 2580 flags.go:64] FLAG: --system-cgroups="" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453160 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453165 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453168 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453171 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453175 2580 flags.go:64] FLAG: --tls-min-version="" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453178 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453181 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453184 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453187 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453190 2580 flags.go:64] FLAG: --v="2" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453195 2580 flags.go:64] FLAG: --version="false" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453199 2580 flags.go:64] FLAG: --vmodule="" Sep 18 13:19:12.461467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453203 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.453206 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453321 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453325 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453328 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453331 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453334 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453338 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453342 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453345 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453348 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453352 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453355 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453358 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453361 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453363 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453366 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453369 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453371 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453374 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:19:12.462103 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453376 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453379 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453382 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453384 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453387 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453390 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453393 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453397 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453400 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453403 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453408 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453411 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453414 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453417 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453419 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453422 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453425 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453428 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453431 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:19:12.462599 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453435 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453438 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453441 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453444 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453447 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453450 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453453 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453456 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453459 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453461 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453464 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453466 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453469 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453471 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453474 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453477 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453479 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453482 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453484 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453487 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:19:12.463133 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453490 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453492 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453495 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453499 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453502 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453504 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453507 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453510 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453512 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453515 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453518 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453521 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453523 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453526 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453529 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453532 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453534 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453537 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453540 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453542 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:19:12.463630 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453545 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453548 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453550 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453553 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453555 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453558 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453560 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453563 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453566 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453568 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453571 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453573 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453576 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453578 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453582 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453585 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453588 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453591 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453593 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453597 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:19:12.464132 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453599 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.453602 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.454105 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.461486 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.461501 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.461522 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.461532 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461587 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461592 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461596 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461599 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461602 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461605 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461609 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:19:12.464621 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461615 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461618 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461622 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461625 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461628 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461632 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461636 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461639 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461641 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461645 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461647 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461650 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461653 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461656 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461658 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461661 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461664 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461666 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461669 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:19:12.464997 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461671 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461674 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461677 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461682 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461685 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461687 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461690 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461693 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461695 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461698 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461700 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461703 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461705 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461708 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461710 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461713 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461735 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461738 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461741 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461744 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:19:12.465466 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461746 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461749 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461751 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461754 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461757 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461759 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461762 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461764 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461767 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461769 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461772 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461774 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461777 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461780 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461782 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461785 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461788 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461791 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461794 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461797 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:19:12.465964 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461799 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461802 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461804 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461807 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461809 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461812 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461814 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461817 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461819 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461822 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461825 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461827 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461830 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461832 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461835 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461837 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461840 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461842 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461845 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461847 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:19:12.466482 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461850 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461852 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461855 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461857 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461860 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461863 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461865 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461868 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461871 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461874 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461877 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461881 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.461884 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.461889 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462003 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:19:12.467087 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462008 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462011 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462013 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462016 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462019 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462023 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462026 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462030 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462033 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462035 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462038 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462041 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462044 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462047 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462050 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462052 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462055 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462058 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462061 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:19:12.467461 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462063 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462066 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462068 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462071 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462074 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462076 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462079 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462082 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462085 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462088 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462090 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462093 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462095 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462098 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462100 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462103 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462106 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462109 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462111 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462114 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:19:12.467938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462117 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462119 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462122 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462124 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462127 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462130 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462132 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462135 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462138 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462140 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462143 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462145 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462148 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462150 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462153 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462155 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462158 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462160 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462163 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462166 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:19:12.468419 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462168 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462171 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462174 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462177 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462179 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462181 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462184 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462186 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462189 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462192 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462195 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462198 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462200 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462203 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462205 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462208 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462213 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462215 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462218 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462221 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:19:12.468921 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462224 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462226 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462229 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462232 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462236 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462239 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462242 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462245 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462248 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462251 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462253 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462256 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462258 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462261 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462264 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462266 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462269 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462271 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:19:12.469501 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:12.462274 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:19:12.470155 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.462278 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:19:12.470155 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.462378 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 13:19:12.470155 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.464595 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 13:19:12.470155 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.465286 2580 server.go:1019] "Starting client certificate rotation" Sep 18 13:19:12.470155 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.465380 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 13:19:12.470155 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.465415 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 13:19:12.470155 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.467554 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 13:19:12.471803 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.471745 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 13:19:12.474866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.474849 2580 log.go:25] "Validated CRI v1 runtime API" Sep 18 13:19:12.476466 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.476452 2580 log.go:25] "Validated CRI v1 image API" Sep 18 13:19:12.477249 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.477230 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 13:19:12.484455 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.484434 2580 fs.go:135] Filesystem UUIDs: map[10a9d97b-a6cc-4f4c-9ec1-1c3f18e21866:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bb8cc1fd-7e38-43ae-90f9-e7e8fcbec46c:/dev/nvme0n1p3] Sep 18 13:19:12.484516 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.484453 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 13:19:12.488555 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.488449 2580 manager.go:216] Machine: {Timestamp:2026-09-18 13:19:12.487994901 +0000 UTC m=+1.997633259 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100986 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2df0aeb1da3ddf1930dc3852f1be7d SystemUUID:ec2df0ae-b1da-3ddf-1930-dc3852f1be7d BootID:a44f2241-5fe1-48d1-9933-f1bda95924f6 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f8:9b:6f:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f8:9b:6f:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:34:73:af:6c:69 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 13:19:12.488555 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.488550 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 13:19:12.488667 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.488646 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 13:19:12.490186 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.490158 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 13:19:12.490308 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.490188 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 13:19:12.491452 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.491440 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 13:19:12.491491 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.491455 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 13:19:12.491491 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.491463 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 13:19:12.491491 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.491473 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 13:19:12.491574 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.491541 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 13:19:12.495531 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.495519 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 18 13:19:12.495645 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.495636 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 13:19:12.495691 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.495671 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 18 13:19:12.495691 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.495690 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 13:19:12.495788 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.495704 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 13:19:12.495788 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.495777 2580 kubelet.go:398] "Adding apiserver pod source" Sep 18 13:19:12.495788 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.495788 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 13:19:12.496147 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.496132 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 13:19:12.496199 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.496172 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 13:19:12.499444 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.499425 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 13:19:12.501872 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.501858 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 13:19:12.501914 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.501888 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 13:19:12.503367 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503343 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 13:19:12.503367 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503367 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 13:19:12.503492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503377 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 13:19:12.503492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503386 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 13:19:12.503492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503400 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 13:19:12.503492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503409 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 13:19:12.503492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503427 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 13:19:12.503492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503436 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 13:19:12.503492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503446 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 13:19:12.503492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503460 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 13:19:12.503492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503473 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 13:19:12.503492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503482 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 13:19:12.503925 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503508 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 13:19:12.503925 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.503517 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 13:19:12.507775 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.507757 2580 server.go:1268] "Started kubelet" Sep 18 13:19:12.507867 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.507842 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 13:19:12.507975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.507890 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 13:19:12.508033 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.508002 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 13:19:12.508527 ip-10-0-129-232 systemd[1]: Started Kubernetes Kubelet. Sep 18 13:19:12.509006 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.508902 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 13:19:12.509229 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.509213 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 18 13:19:12.509279 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.509237 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 13:19:12.509764 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.509708 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 13:19:12.509903 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.509752 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 13:19:12.512478 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.512455 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 13:19:12.512559 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.512529 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 13:19:12.516313 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.516300 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 13:19:12.516400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.516356 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 13:19:12.516400 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.516371 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found" Sep 18 13:19:12.516844 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.516820 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 13:19:12.516931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.516855 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 13:19:12.516931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.516825 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 13:19:12.517022 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.517010 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 18 13:19:12.517064 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.517024 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 18 13:19:12.517315 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.517300 2580 factory.go:55] Registering systemd factory Sep 18 13:19:12.517315 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.517315 2580 factory.go:223] Registration of the systemd container factory successfully Sep 18 13:19:12.517517 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.517505 2580 factory.go:153] Registering CRI-O factory Sep 18 13:19:12.517517 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.517518 2580 factory.go:223] Registration of the crio container factory successfully Sep 18 13:19:12.517623 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.517570 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 13:19:12.517623 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.517584 2580 factory.go:103] Registering Raw factory Sep 18 13:19:12.517623 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.517594 2580 manager.go:1196] Started watching for new ooms in manager Sep 18 13:19:12.518155 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.518137 2580 manager.go:349] Starting recovery of all containers Sep 18 13:19:12.520265 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.520238 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 13:19:12.520395 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.520367 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 13:19:12.541059 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.541038 2580 manager.go:354] Recovery completed Sep 18 13:19:12.551115 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.551096 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:19:12.553546 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.553529 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:19:12.553608 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.553557 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:19:12.553608 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.553567 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:19:12.554104 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.553199 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-232.ec2.internal.18d66cd252667d73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-232.ec2.internal,UID:ip-10-0-129-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-232.ec2.internal,},FirstTimestamp:2026-09-18 13:19:12.507731315 +0000 UTC m=+2.017369672,LastTimestamp:2026-09-18 13:19:12.507731315 +0000 UTC m=+2.017369672,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-232.ec2.internal,}" Sep 18 13:19:12.554212 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.554132 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 13:19:12.554212 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.554145 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 13:19:12.554212 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.554162 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 18 13:19:12.554212 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.554166 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:19:12.555135 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.555117 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:19:12.555202 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.555146 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:19:12.555202 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.555156 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:19:12.560334 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.560321 2580 policy_none.go:49] "None policy: Start" Sep 18 13:19:12.560401 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.560337 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 13:19:12.560401 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.560348 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 13:19:12.562342 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.562332 2580 policy_none.go:47] "Start" Sep 18 13:19:12.570311 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.570245 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-232.ec2.internal.18d66cd255218c09 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-232.ec2.internal,UID:ip-10-0-129-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-232.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-232.ec2.internal,},FirstTimestamp:2026-09-18 13:19:12.553544713 +0000 UTC m=+2.063183070,LastTimestamp:2026-09-18 13:19:12.553544713 +0000 UTC m=+2.063183070,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-232.ec2.internal,}" Sep 18 13:19:12.581624 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.581526 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-232.ec2.internal.18d66cd25521ced2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-232.ec2.internal,UID:ip-10-0-129-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-232.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-232.ec2.internal,},FirstTimestamp:2026-09-18 13:19:12.55356181 +0000 UTC m=+2.063200167,LastTimestamp:2026-09-18 13:19:12.55356181 +0000 UTC m=+2.063200167,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-232.ec2.internal,}" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.594350 2580 manager.go:337] "Starting Device Plugin manager" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.594383 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.594393 2580 server.go:87] "Starting device plugin registration server" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.594656 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.594809 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.594888 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.594965 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.594971 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.595451 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.595503 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-232.ec2.internal\" not found" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.596332 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-44hn5" Sep 18 13:19:12.599709 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.598577 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-232.ec2.internal.18d66cd25521f061 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-232.ec2.internal,UID:ip-10-0-129-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-232.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-232.ec2.internal,},FirstTimestamp:2026-09-18 13:19:12.553570401 +0000 UTC m=+2.063208757,LastTimestamp:2026-09-18 13:19:12.553570401 +0000 UTC m=+2.063208757,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-232.ec2.internal,}" Sep 18 13:19:12.606096 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.606079 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-44hn5" Sep 18 13:19:12.610070 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.610009 2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-232.ec2.internal.18d66cd255218c09\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-232.ec2.internal.18d66cd255218c09 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-232.ec2.internal,UID:ip-10-0-129-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-232.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-232.ec2.internal,},FirstTimestamp:2026-09-18 13:19:12.553544713 +0000 UTC m=+2.063183070,LastTimestamp:2026-09-18 13:19:12.555133265 +0000 UTC m=+2.064771622,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-232.ec2.internal,}" Sep 18 13:19:12.618206 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.618178 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 13:19:12.619448 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.619429 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 13:19:12.619524 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.619484 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 13:19:12.619524 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.619512 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 13:19:12.619626 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.619551 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 13:19:12.623134 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.623117 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:19:12.695302 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.695284 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:19:12.696079 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.696061 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:19:12.696165 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.696109 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:19:12.696165 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.696134 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:19:12.696165 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.696163 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.718657 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.718608 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.718657 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.718629 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-232.ec2.internal\": node \"ip-10-0-129-232.ec2.internal\" not found" Sep 18 13:19:12.719941 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.719922 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal"] Sep 18 13:19:12.719989 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.719982 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:19:12.721055 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.721040 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:19:12.721131 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.721070 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:19:12.721131 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.721082 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:19:12.723244 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.723231 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:19:12.723359 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.723345 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.723412 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.723377 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:19:12.723872 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.723852 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:19:12.723872 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.723862 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:19:12.723991 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.723881 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:19:12.723991 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.723896 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:19:12.724063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.723882 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:19:12.724063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.724030 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:19:12.725956 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.725943 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.726023 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.725966 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:19:12.726515 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.726502 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:19:12.726575 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.726524 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:19:12.726575 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.726534 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:19:12.754352 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.754338 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-232.ec2.internal\" not found" node="ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.758563 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.758550 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-232.ec2.internal\" not found" node="ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.811979 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.811959 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found" Sep 18 13:19:12.818606 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.818585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19ae1cf8d903f126afc3c86c6cfdbd16-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"19ae1cf8d903f126afc3c86c6cfdbd16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.818691 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.818610 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19ae1cf8d903f126afc3c86c6cfdbd16-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"19ae1cf8d903f126afc3c86c6cfdbd16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.818691 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.818625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66735a565a3af6f436b6c35ffc205408-config\") pod \"kube-apiserver-proxy-ip-10-0-129-232.ec2.internal\" (UID: \"66735a565a3af6f436b6c35ffc205408\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.912276 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:12.912255 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found" Sep 18 13:19:12.918749 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.918732 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19ae1cf8d903f126afc3c86c6cfdbd16-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"19ae1cf8d903f126afc3c86c6cfdbd16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.918829 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.918753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19ae1cf8d903f126afc3c86c6cfdbd16-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"19ae1cf8d903f126afc3c86c6cfdbd16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.918829 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.918770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66735a565a3af6f436b6c35ffc205408-config\") pod \"kube-apiserver-proxy-ip-10-0-129-232.ec2.internal\" (UID: \"66735a565a3af6f436b6c35ffc205408\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.918829 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.918801 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66735a565a3af6f436b6c35ffc205408-config\") pod \"kube-apiserver-proxy-ip-10-0-129-232.ec2.internal\" (UID: \"66735a565a3af6f436b6c35ffc205408\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.918829 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.918816 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19ae1cf8d903f126afc3c86c6cfdbd16-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"19ae1cf8d903f126afc3c86c6cfdbd16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" Sep 18 13:19:12.918959 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:12.918821 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19ae1cf8d903f126afc3c86c6cfdbd16-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal\" (UID: \"19ae1cf8d903f126afc3c86c6cfdbd16\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" Sep 18 13:19:13.012842 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.012787 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found" Sep 18 13:19:13.058170 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.058148 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" Sep 18 13:19:13.063507 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.063155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" Sep 18 13:19:13.113727 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.113689 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found" Sep 18 13:19:13.214258 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.214232 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found" Sep 18 13:19:13.314766 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.314700 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found" Sep 18 13:19:13.415216 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.415196 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-232.ec2.internal\" not found" Sep 18 13:19:13.465667 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.465639 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 13:19:13.466123 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.465845 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 13:19:13.485345 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.485322 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:19:13.486005 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.485986 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:19:13.495951 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.495938 2580 apiserver.go:52] "Watching apiserver" Sep 18 13:19:13.508313 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.508289 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 13:19:13.508608 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.508588 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-f9l47","openshift-network-operator/iptables-alerter-6q8gw","openshift-ovn-kubernetes/ovnkube-node-lsq6h","kube-system/global-pull-secret-syncer-zjkgw","openshift-cluster-node-tuning-operator/tuned-hh48c","openshift-dns/node-resolver-c9xcg","openshift-image-registry/node-ca-tz7qx","openshift-multus/multus-additional-cni-plugins-4zxnd","openshift-multus/multus-npfmn","openshift-multus/network-metrics-daemon-mkf52","kube-system/konnectivity-agent-br5x2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn"] Sep 18 13:19:13.511017 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.511001 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:13.511116 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.511073 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:13.512987 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.512972 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.515007 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.514989 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.515964 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.515943 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 13:19:13.516508 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.516492 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" Sep 18 13:19:13.516549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.516536 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 13:19:13.516597 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.516549 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 13:19:13.516731 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.516706 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xsrmf\"" Sep 18 13:19:13.517032 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.517020 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.519091 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.519076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.521145 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.521133 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.521858 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.521843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a2d3146-c0f0-48bc-822e-c7300770ebe6-iptables-alerter-script\") pod \"iptables-alerter-6q8gw\" (UID: \"7a2d3146-c0f0-48bc-822e-c7300770ebe6\") " pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.521916 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.521866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1090a9ee-3fad-4085-b97f-bae07eef0fc3-system-cni-dir\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.521916 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.521884 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-var-lib-kubelet\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.521916 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.521897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a2d3146-c0f0-48bc-822e-c7300770ebe6-host-slash\") pod \"iptables-alerter-6q8gw\" (UID: \"7a2d3146-c0f0-48bc-822e-c7300770ebe6\") " pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.521916 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.521911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-kubernetes\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522033 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.521964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-sysctl-conf\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522033 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.521988 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-systemd\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522033 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/322730aa-4fe2-413f-9df6-8249b41758ee-serviceca\") pod \"node-ca-tz7qx\" (UID: \"322730aa-4fe2-413f-9df6-8249b41758ee\") " pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.522118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpwk6\" (UniqueName: \"kubernetes.io/projected/7a2d3146-c0f0-48bc-822e-c7300770ebe6-kube-api-access-dpwk6\") pod \"iptables-alerter-6q8gw\" (UID: \"7a2d3146-c0f0-48bc-822e-c7300770ebe6\") " pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.522118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1090a9ee-3fad-4085-b97f-bae07eef0fc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.522118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522078 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1090a9ee-3fad-4085-b97f-bae07eef0fc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.522118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-tuned\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522108 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-host\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522260 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1090a9ee-3fad-4085-b97f-bae07eef0fc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.522260 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-run\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522260 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522171 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzrlq\" (UniqueName: \"kubernetes.io/projected/7b916f67-d86f-4473-8c30-fc5a908e8dd2-kube-api-access-xzrlq\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522260 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/322730aa-4fe2-413f-9df6-8249b41758ee-host\") pod \"node-ca-tz7qx\" (UID: \"322730aa-4fe2-413f-9df6-8249b41758ee\") " pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.522260 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522197 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1090a9ee-3fad-4085-b97f-bae07eef0fc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.522260 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-lib-modules\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522260 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522240 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl4zn\" (UniqueName: \"kubernetes.io/projected/322730aa-4fe2-413f-9df6-8249b41758ee-kube-api-access-nl4zn\") pod \"node-ca-tz7qx\" (UID: \"322730aa-4fe2-413f-9df6-8249b41758ee\") " pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.522485 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522262 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntk6r\" (UniqueName: \"kubernetes.io/projected/1090a9ee-3fad-4085-b97f-bae07eef0fc3-kube-api-access-ntk6r\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.522485 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k8br\" (UniqueName: \"kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br\") pod \"network-check-target-f9l47\" (UID: \"d7ecc191-ecaa-4911-9fbd-3150a630dba6\") " pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:13.522485 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522290 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-modprobe-d\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522485 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-sysconfig\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522485 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-sysctl-d\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522485 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522367 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-sys\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522485 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b916f67-d86f-4473-8c30-fc5a908e8dd2-tmp\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.522485 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.522401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1090a9ee-3fad-4085-b97f-bae07eef0fc3-cnibin\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.523270 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.523255 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:13.523344 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.523324 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:13.525513 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.525500 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.527076 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.526968 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 13:19:13.527076 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.527048 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 13:19:13.527220 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.527133 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 13:19:13.527220 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.527161 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 13:19:13.527220 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.527196 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-czgtm\"" Sep 18 13:19:13.527220 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.527206 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:19:13.527380 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.527223 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 13:19:13.527380 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.527325 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zfdkc\"" Sep 18 13:19:13.527380 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.527326 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 13:19:13.527648 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.527635 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:13.527707 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.527681 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:13.529559 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.529540 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 13:19:13.529641 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.529591 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gdcgk\"" Sep 18 13:19:13.529782 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.529767 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 13:19:13.529898 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.529883 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 13:19:13.529999 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.529986 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vtl4v\"" Sep 18 13:19:13.530061 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.529988 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.532245 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.532233 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:13.534371 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.534357 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.538400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.538380 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 13:19:13.538505 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.538490 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 13:19:13.538668 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.538655 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 13:19:13.538750 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.538735 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2769j\"" Sep 18 13:19:13.539357 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.539151 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 13:19:13.543862 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.543845 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 13:19:13.543936 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.543922 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 13:19:13.544043 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.544029 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 13:19:13.552260 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.552245 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 13:19:13.552347 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.552245 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 13:19:13.552471 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.552459 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 13:19:13.552539 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.552523 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 13:19:13.552592 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.552567 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 13:19:13.552885 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.552872 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 13:19:13.552960 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.552922 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:19:13.553228 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.553208 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kgrpr\"" Sep 18 13:19:13.553291 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.553278 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xbh96\"" Sep 18 13:19:13.553498 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.553485 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-spcts\"" Sep 18 13:19:13.553551 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.553539 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 13:19:13.557297 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.557280 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 13:19:13.565534 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.565496 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 13:19:13.565594 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.565554 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" Sep 18 13:19:13.566020 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.566005 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal"] Sep 18 13:19:13.586024 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.586009 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal"] Sep 18 13:19:13.586787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.586775 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j67fh" Sep 18 13:19:13.586913 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.586900 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 13:19:13.598106 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.598088 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j67fh" Sep 18 13:19:13.611439 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.611399 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 13:14:12 +0000 UTC" deadline="2028-02-28 10:36:54.799125667 +0000 UTC" Sep 18 13:19:13.611439 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.611431 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12669h17m41.187697057s" Sep 18 13:19:13.617888 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.617871 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 13:19:13.623065 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623047 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-host\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.623150 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-etc-kubernetes\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.623150 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-run-ovn\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.623150 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623113 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-node-log\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.623150 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623132 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1090a9ee-3fad-4085-b97f-bae07eef0fc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.623327 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623158 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/322730aa-4fe2-413f-9df6-8249b41758ee-host\") pod \"node-ca-tz7qx\" (UID: \"322730aa-4fe2-413f-9df6-8249b41758ee\") " pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.623327 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623166 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-host\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.623327 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-cni-dir\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.623327 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:13.623327 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623213 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/322730aa-4fe2-413f-9df6-8249b41758ee-host\") pod \"node-ca-tz7qx\" (UID: \"322730aa-4fe2-413f-9df6-8249b41758ee\") " pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.623327 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1090a9ee-3fad-4085-b97f-bae07eef0fc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.623327 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623306 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-lib-modules\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.623327 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl4zn\" (UniqueName: \"kubernetes.io/projected/322730aa-4fe2-413f-9df6-8249b41758ee-kube-api-access-nl4zn\") pod \"node-ca-tz7qx\" (UID: \"322730aa-4fe2-413f-9df6-8249b41758ee\") " pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.623544 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-conf-dir\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.623544 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623354 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-slash\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.623544 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6735cebf-aaab-4717-b5e3-d729b812b2dd-env-overrides\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.623544 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623411 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-lib-modules\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.623544 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0361a153-89d1-45d7-a84f-a3fcd4368a2c-dbus\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:13.623544 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-modprobe-d\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.623544 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-sys\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.623544 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-device-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-cnibin\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623585 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-modprobe-d\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623579 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-sys\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623610 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6735cebf-aaab-4717-b5e3-d729b812b2dd-ovnkube-script-lib\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623633 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1090a9ee-3fad-4085-b97f-bae07eef0fc3-cnibin\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q86cw\" (UniqueName: \"kubernetes.io/projected/546cf32c-d65c-47d1-bfa7-b4fd391638eb-kube-api-access-q86cw\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623668 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-daemon-config\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-run-systemd\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623702 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1090a9ee-3fad-4085-b97f-bae07eef0fc3-cnibin\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623735 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-run-openvswitch\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e696015-7fc3-4280-852c-9929002e2dbf-konnectivity-ca\") pod \"konnectivity-agent-br5x2\" (UID: \"8e696015-7fc3-4280-852c-9929002e2dbf\") " pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1090a9ee-3fad-4085-b97f-bae07eef0fc3-system-cni-dir\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.623787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623787 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-var-lib-kubelet\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-socket-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623816 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-var-lib-cni-bin\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-var-lib-openvswitch\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623829 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1090a9ee-3fad-4085-b97f-bae07eef0fc3-system-cni-dir\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623845 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-var-lib-kubelet\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623903 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a2d3146-c0f0-48bc-822e-c7300770ebe6-host-slash\") pod \"iptables-alerter-6q8gw\" (UID: \"7a2d3146-c0f0-48bc-822e-c7300770ebe6\") " pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-kubernetes\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-sysctl-conf\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623959 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-systemd\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1090a9ee-3fad-4085-b97f-bae07eef0fc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-kubernetes\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.623994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-tuned\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624017 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctgk6\" (UniqueName: \"kubernetes.io/projected/380ff550-0e7a-46ea-a947-9fff416d9181-kube-api-access-ctgk6\") pod \"node-resolver-c9xcg\" (UID: \"380ff550-0e7a-46ea-a947-9fff416d9181\") " pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624041 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-run-k8s-cni-cncf-io\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624010 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a2d3146-c0f0-48bc-822e-c7300770ebe6-host-slash\") pod \"iptables-alerter-6q8gw\" (UID: \"7a2d3146-c0f0-48bc-822e-c7300770ebe6\") " pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.624400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624073 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-sysctl-conf\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58zd5\" (UniqueName: \"kubernetes.io/projected/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-kube-api-access-58zd5\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624110 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-systemd\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624113 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr2w4\" (UniqueName: \"kubernetes.io/projected/7e79de33-0f2f-4207-9ea9-276b1f3744f2-kube-api-access-tr2w4\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624139 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75vl\" (UniqueName: \"kubernetes.io/projected/6735cebf-aaab-4717-b5e3-d729b812b2dd-kube-api-access-c75vl\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-registration-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-socket-dir-parent\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-run-multus-certs\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-log-socket\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0361a153-89d1-45d7-a84f-a3fcd4368a2c-kubelet-config\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-run\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624308 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzrlq\" (UniqueName: \"kubernetes.io/projected/7b916f67-d86f-4473-8c30-fc5a908e8dd2-kube-api-access-xzrlq\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-system-cni-dir\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624358 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-run\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-var-lib-cni-multus\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-cni-netd\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.625160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-etc-openvswitch\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6735cebf-aaab-4717-b5e3-d729b812b2dd-ovn-node-metrics-cert\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntk6r\" (UniqueName: \"kubernetes.io/projected/1090a9ee-3fad-4085-b97f-bae07eef0fc3-kube-api-access-ntk6r\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624481 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1090a9ee-3fad-4085-b97f-bae07eef0fc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624494 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8br\" (UniqueName: \"kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br\") pod \"network-check-target-f9l47\" (UID: \"d7ecc191-ecaa-4911-9fbd-3150a630dba6\") " pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624503 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1090a9ee-3fad-4085-b97f-bae07eef0fc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624468 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1090a9ee-3fad-4085-b97f-bae07eef0fc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-sysconfig\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624579 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-sysconfig\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624585 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-sysctl-d\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b916f67-d86f-4473-8c30-fc5a908e8dd2-tmp\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624642 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/380ff550-0e7a-46ea-a947-9fff416d9181-hosts-file\") pod \"node-resolver-c9xcg\" (UID: \"380ff550-0e7a-46ea-a947-9fff416d9181\") " pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-hostroot\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624690 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-sysctl-d\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624697 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-run-netns\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.625694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624789 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-cni-bin\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624810 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6735cebf-aaab-4717-b5e3-d729b812b2dd-ovnkube-config\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e696015-7fc3-4280-852c-9929002e2dbf-agent-certs\") pod \"konnectivity-agent-br5x2\" (UID: \"8e696015-7fc3-4280-852c-9929002e2dbf\") " pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624882 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a2d3146-c0f0-48bc-822e-c7300770ebe6-iptables-alerter-script\") pod \"iptables-alerter-6q8gw\" (UID: \"7a2d3146-c0f0-48bc-822e-c7300770ebe6\") " pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624909 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-cni-binary-copy\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-kubelet\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.624982 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-systemd-units\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.625008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/322730aa-4fe2-413f-9df6-8249b41758ee-serviceca\") pod \"node-ca-tz7qx\" (UID: \"322730aa-4fe2-413f-9df6-8249b41758ee\") " pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.625032 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-sys-fs\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.625054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-var-lib-kubelet\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.625089 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpwk6\" (UniqueName: \"kubernetes.io/projected/7a2d3146-c0f0-48bc-822e-c7300770ebe6-kube-api-access-dpwk6\") pod \"iptables-alerter-6q8gw\" (UID: \"7a2d3146-c0f0-48bc-822e-c7300770ebe6\") " pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.625155 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1090a9ee-3fad-4085-b97f-bae07eef0fc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.625231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380ff550-0e7a-46ea-a947-9fff416d9181-tmp-dir\") pod \"node-resolver-c9xcg\" (UID: \"380ff550-0e7a-46ea-a947-9fff416d9181\") " pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.625270 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-run-netns\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.625310 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1090a9ee-3fad-4085-b97f-bae07eef0fc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.625383 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a2d3146-c0f0-48bc-822e-c7300770ebe6-iptables-alerter-script\") pod \"iptables-alerter-6q8gw\" (UID: \"7a2d3146-c0f0-48bc-822e-c7300770ebe6\") " pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.626284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.625438 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/322730aa-4fe2-413f-9df6-8249b41758ee-serviceca\") pod \"node-ca-tz7qx\" (UID: \"322730aa-4fe2-413f-9df6-8249b41758ee\") " pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.627167 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.627148 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b916f67-d86f-4473-8c30-fc5a908e8dd2-tmp\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.627236 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.627224 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b916f67-d86f-4473-8c30-fc5a908e8dd2-etc-tuned\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.637567 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.637444 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:19:13.645982 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.645954 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntk6r\" (UniqueName: \"kubernetes.io/projected/1090a9ee-3fad-4085-b97f-bae07eef0fc3-kube-api-access-ntk6r\") pod \"multus-additional-cni-plugins-4zxnd\" (UID: \"1090a9ee-3fad-4085-b97f-bae07eef0fc3\") " pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.646293 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.646275 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzrlq\" (UniqueName: \"kubernetes.io/projected/7b916f67-d86f-4473-8c30-fc5a908e8dd2-kube-api-access-xzrlq\") pod \"tuned-hh48c\" (UID: \"7b916f67-d86f-4473-8c30-fc5a908e8dd2\") " pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.647537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.647520 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl4zn\" (UniqueName: \"kubernetes.io/projected/322730aa-4fe2-413f-9df6-8249b41758ee-kube-api-access-nl4zn\") pod \"node-ca-tz7qx\" (UID: \"322730aa-4fe2-413f-9df6-8249b41758ee\") " pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.652257 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.652241 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:19:13.652359 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.652259 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:19:13.652359 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.652270 2580 projected.go:196] Error preparing data for projected volume kube-api-access-4k8br for pod openshift-network-diagnostics/network-check-target-f9l47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:13.654659 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.652698 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br podName:d7ecc191-ecaa-4911-9fbd-3150a630dba6 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:14.152671055 +0000 UTC m=+3.662309416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4k8br" (UniqueName: "kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br") pod "network-check-target-f9l47" (UID: "d7ecc191-ecaa-4911-9fbd-3150a630dba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:13.657225 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.657127 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpwk6\" (UniqueName: \"kubernetes.io/projected/7a2d3146-c0f0-48bc-822e-c7300770ebe6-kube-api-access-dpwk6\") pod \"iptables-alerter-6q8gw\" (UID: \"7a2d3146-c0f0-48bc-822e-c7300770ebe6\") " pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.725866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.725836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6735cebf-aaab-4717-b5e3-d729b812b2dd-env-overrides\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.725866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.725866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0361a153-89d1-45d7-a84f-a3fcd4368a2c-dbus\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.725884 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.725899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-device-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.725915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-cnibin\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.725929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6735cebf-aaab-4717-b5e3-d729b812b2dd-ovnkube-script-lib\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.725947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q86cw\" (UniqueName: \"kubernetes.io/projected/546cf32c-d65c-47d1-bfa7-b4fd391638eb-kube-api-access-q86cw\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.725969 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.725984 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-device-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.725970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-daemon-config\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726009 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-cnibin\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726019 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0361a153-89d1-45d7-a84f-a3fcd4368a2c-dbus\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726043 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-run-systemd\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.726067 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-run-openvswitch\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e696015-7fc3-4280-852c-9929002e2dbf-konnectivity-ca\") pod \"konnectivity-agent-br5x2\" (UID: \"8e696015-7fc3-4280-852c-9929002e2dbf\") " pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-socket-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726138 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-run-systemd\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726142 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-run-openvswitch\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-var-lib-cni-bin\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-var-lib-openvswitch\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726244 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-socket-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctgk6\" (UniqueName: \"kubernetes.io/projected/380ff550-0e7a-46ea-a947-9fff416d9181-kube-api-access-ctgk6\") pod \"node-resolver-c9xcg\" (UID: \"380ff550-0e7a-46ea-a947-9fff416d9181\") " pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-run-k8s-cni-cncf-io\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726275 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-var-lib-openvswitch\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58zd5\" (UniqueName: \"kubernetes.io/projected/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-kube-api-access-58zd5\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726317 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-var-lib-cni-bin\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr2w4\" (UniqueName: \"kubernetes.io/projected/7e79de33-0f2f-4207-9ea9-276b1f3744f2-kube-api-access-tr2w4\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c75vl\" (UniqueName: \"kubernetes.io/projected/6735cebf-aaab-4717-b5e3-d729b812b2dd-kube-api-access-c75vl\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-registration-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.726651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726378 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6735cebf-aaab-4717-b5e3-d729b812b2dd-env-overrides\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-socket-dir-parent\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726444 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-run-k8s-cni-cncf-io\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-run-multus-certs\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726491 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-socket-dir-parent\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726495 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-log-socket\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726511 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-daemon-config\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726520 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0361a153-89d1-45d7-a84f-a3fcd4368a2c-kubelet-config\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726539 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6735cebf-aaab-4717-b5e3-d729b812b2dd-ovnkube-script-lib\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-system-cni-dir\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726647 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-run-multus-certs\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726667 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-registration-dir\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e696015-7fc3-4280-852c-9929002e2dbf-konnectivity-ca\") pod \"konnectivity-agent-br5x2\" (UID: \"8e696015-7fc3-4280-852c-9929002e2dbf\") " pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726700 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-system-cni-dir\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726695 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-log-socket\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726737 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-var-lib-cni-multus\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-var-lib-cni-multus\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726748 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0361a153-89d1-45d7-a84f-a3fcd4368a2c-kubelet-config\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:13.727549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-cni-netd\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726786 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726803 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-etc-openvswitch\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726826 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-cni-netd\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726831 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6735cebf-aaab-4717-b5e3-d729b812b2dd-ovn-node-metrics-cert\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/380ff550-0e7a-46ea-a947-9fff416d9181-hosts-file\") pod \"node-resolver-c9xcg\" (UID: \"380ff550-0e7a-46ea-a947-9fff416d9181\") " pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726884 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-etc-openvswitch\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-hostroot\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726932 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/380ff550-0e7a-46ea-a947-9fff416d9181-hosts-file\") pod \"node-resolver-c9xcg\" (UID: \"380ff550-0e7a-46ea-a947-9fff416d9181\") " pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-run-netns\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726975 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-hostroot\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-cni-bin\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6735cebf-aaab-4717-b5e3-d729b812b2dd-ovnkube-config\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727010 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-run-netns\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.726968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e696015-7fc3-4280-852c-9929002e2dbf-agent-certs\") pod \"konnectivity-agent-br5x2\" (UID: \"8e696015-7fc3-4280-852c-9929002e2dbf\") " pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:13.728232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-cni-binary-copy\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727066 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-kubelet\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-systemd-units\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-sys-fs\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727174 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-var-lib-kubelet\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380ff550-0e7a-46ea-a947-9fff416d9181-tmp-dir\") pod \"node-resolver-c9xcg\" (UID: \"380ff550-0e7a-46ea-a947-9fff416d9181\") " pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727239 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-run-netns\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-etc-kubernetes\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-run-ovn\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-node-log\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727339 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-cni-dir\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727351 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/546cf32c-d65c-47d1-bfa7-b4fd391638eb-sys-fs\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727056 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-cni-bin\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-conf-dir\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-slash\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.728795 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.727444 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727489 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-slash\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727518 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-cni-binary-copy\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.727512 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs podName:7e79de33-0f2f-4207-9ea9-276b1f3744f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:14.227494983 +0000 UTC m=+3.737133347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs") pod "network-metrics-daemon-mkf52" (UID: "7e79de33-0f2f-4207-9ea9-276b1f3744f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727533 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6735cebf-aaab-4717-b5e3-d729b812b2dd-ovnkube-config\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-host-var-lib-kubelet\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727554 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-systemd-units\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727520 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-kubelet\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727582 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-run-ovn\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727611 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-cni-dir\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727628 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-host-run-netns\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727637 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-multus-conf-dir\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727656 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6735cebf-aaab-4717-b5e3-d729b812b2dd-node-log\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.727678 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727677 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-etc-kubernetes\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.727752 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret podName:0361a153-89d1-45d7-a84f-a3fcd4368a2c nodeName:}" failed. No retries permitted until 2026-09-18 13:19:14.227709207 +0000 UTC m=+3.737347569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret") pod "global-pull-secret-syncer-zjkgw" (UID: "0361a153-89d1-45d7-a84f-a3fcd4368a2c") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:13.729339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.727816 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380ff550-0e7a-46ea-a947-9fff416d9181-tmp-dir\") pod \"node-resolver-c9xcg\" (UID: \"380ff550-0e7a-46ea-a947-9fff416d9181\") " pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.729834 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.729535 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6735cebf-aaab-4717-b5e3-d729b812b2dd-ovn-node-metrics-cert\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.729834 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.729608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e696015-7fc3-4280-852c-9929002e2dbf-agent-certs\") pod \"konnectivity-agent-br5x2\" (UID: \"8e696015-7fc3-4280-852c-9929002e2dbf\") " pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:13.749469 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.749442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q86cw\" (UniqueName: \"kubernetes.io/projected/546cf32c-d65c-47d1-bfa7-b4fd391638eb-kube-api-access-q86cw\") pod \"aws-ebs-csi-driver-node-vhvcn\" (UID: \"546cf32c-d65c-47d1-bfa7-b4fd391638eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.757472 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.757446 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58zd5\" (UniqueName: \"kubernetes.io/projected/4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7-kube-api-access-58zd5\") pod \"multus-npfmn\" (UID: \"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7\") " pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.763481 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.763463 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr2w4\" (UniqueName: \"kubernetes.io/projected/7e79de33-0f2f-4207-9ea9-276b1f3744f2-kube-api-access-tr2w4\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:13.763772 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.763757 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctgk6\" (UniqueName: \"kubernetes.io/projected/380ff550-0e7a-46ea-a947-9fff416d9181-kube-api-access-ctgk6\") pod \"node-resolver-c9xcg\" (UID: \"380ff550-0e7a-46ea-a947-9fff416d9181\") " pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.765635 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.765620 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75vl\" (UniqueName: \"kubernetes.io/projected/6735cebf-aaab-4717-b5e3-d729b812b2dd-kube-api-access-c75vl\") pod \"ovnkube-node-lsq6h\" (UID: \"6735cebf-aaab-4717-b5e3-d729b812b2dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.830938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.830872 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66735a565a3af6f436b6c35ffc205408.slice/crio-a471e053a754c953f63be034db3fc3eed3675438c2e8a4d25da043701243e7c7 WatchSource:0}: Error finding container a471e053a754c953f63be034db3fc3eed3675438c2e8a4d25da043701243e7c7: Status 404 returned error can't find the container with id a471e053a754c953f63be034db3fc3eed3675438c2e8a4d25da043701243e7c7 Sep 18 13:19:13.831765 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.831739 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ae1cf8d903f126afc3c86c6cfdbd16.slice/crio-aa089c9b75defbe63a4667da4922253fe6f472de204bdde2680afcded3ecbada WatchSource:0}: Error finding container aa089c9b75defbe63a4667da4922253fe6f472de204bdde2680afcded3ecbada: Status 404 returned error can't find the container with id aa089c9b75defbe63a4667da4922253fe6f472de204bdde2680afcded3ecbada Sep 18 13:19:13.836539 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.836524 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:19:13.850252 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.850223 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6q8gw" Sep 18 13:19:13.859076 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.859058 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2d3146_c0f0_48bc_822e_c7300770ebe6.slice/crio-6fd4d0efa9fd661a4906c5558de61e5616f164bce8f584ff9aaa6c4ba4350a15 WatchSource:0}: Error finding container 6fd4d0efa9fd661a4906c5558de61e5616f164bce8f584ff9aaa6c4ba4350a15: Status 404 returned error can't find the container with id 6fd4d0efa9fd661a4906c5558de61e5616f164bce8f584ff9aaa6c4ba4350a15 Sep 18 13:19:13.869408 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.869384 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hh48c" Sep 18 13:19:13.876874 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.876855 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b916f67_d86f_4473_8c30_fc5a908e8dd2.slice/crio-622b12240b75df8cb3e1a3434f69fee0b2de552524fbd4679fc3cd726ca097d6 WatchSource:0}: Error finding container 622b12240b75df8cb3e1a3434f69fee0b2de552524fbd4679fc3cd726ca097d6: Status 404 returned error can't find the container with id 622b12240b75df8cb3e1a3434f69fee0b2de552524fbd4679fc3cd726ca097d6 Sep 18 13:19:13.886455 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.886439 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tz7qx" Sep 18 13:19:13.894354 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.894334 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322730aa_4fe2_413f_9df6_8249b41758ee.slice/crio-206175c70103c37cfa5660f84a413c55cc276b1228b3507f7a30a983d039036a WatchSource:0}: Error finding container 206175c70103c37cfa5660f84a413c55cc276b1228b3507f7a30a983d039036a: Status 404 returned error can't find the container with id 206175c70103c37cfa5660f84a413c55cc276b1228b3507f7a30a983d039036a Sep 18 13:19:13.900540 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.900524 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" Sep 18 13:19:13.910595 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.910570 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1090a9ee_3fad_4085_b97f_bae07eef0fc3.slice/crio-bc883ddeec4d7369beb7ee5fe4ff6a3ee64ee48d4e6446b652388f4fe5c6b2c1 WatchSource:0}: Error finding container bc883ddeec4d7369beb7ee5fe4ff6a3ee64ee48d4e6446b652388f4fe5c6b2c1: Status 404 returned error can't find the container with id bc883ddeec4d7369beb7ee5fe4ff6a3ee64ee48d4e6446b652388f4fe5c6b2c1 Sep 18 13:19:13.911584 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.911569 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-npfmn" Sep 18 13:19:13.915687 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.915672 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:13.920227 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.920207 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dfc7c04_8dc1_4e9a_a4bf_5da9fc25aff7.slice/crio-0f602b68d027fdc60fa3935136a7952e924644e08d495e11fe044e77bc84bcbc WatchSource:0}: Error finding container 0f602b68d027fdc60fa3935136a7952e924644e08d495e11fe044e77bc84bcbc: Status 404 returned error can't find the container with id 0f602b68d027fdc60fa3935136a7952e924644e08d495e11fe044e77bc84bcbc Sep 18 13:19:13.924556 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.924538 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6735cebf_aaab_4717_b5e3_d729b812b2dd.slice/crio-c95e50172108362879fb9016e77984f962173bff30d696d9d7123934b9130b9a WatchSource:0}: Error finding container c95e50172108362879fb9016e77984f962173bff30d696d9d7123934b9130b9a: Status 404 returned error can't find the container with id c95e50172108362879fb9016e77984f962173bff30d696d9d7123934b9130b9a Sep 18 13:19:13.935673 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.935657 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c9xcg" Sep 18 13:19:13.939354 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.939275 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:13.944894 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.944874 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380ff550_0e7a_46ea_a947_9fff416d9181.slice/crio-ab8dc6f78d84d76d6db1bdc3ba7423d5569075f3418eddc9dcb6c7366d65d3a9 WatchSource:0}: Error finding container ab8dc6f78d84d76d6db1bdc3ba7423d5569075f3418eddc9dcb6c7366d65d3a9: Status 404 returned error can't find the container with id ab8dc6f78d84d76d6db1bdc3ba7423d5569075f3418eddc9dcb6c7366d65d3a9 Sep 18 13:19:13.947381 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.947358 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e696015_7fc3_4280_852c_9929002e2dbf.slice/crio-f53754980b1bddb9ef1f74834aa901c23cbcc2ed11619a5d501dccdc1aa97df2 WatchSource:0}: Error finding container f53754980b1bddb9ef1f74834aa901c23cbcc2ed11619a5d501dccdc1aa97df2: Status 404 returned error can't find the container with id f53754980b1bddb9ef1f74834aa901c23cbcc2ed11619a5d501dccdc1aa97df2 Sep 18 13:19:13.962467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:13.962451 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" Sep 18 13:19:13.971338 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:13.971313 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546cf32c_d65c_47d1_bfa7_b4fd391638eb.slice/crio-560ad6ed38d84fcc722ebb29b4c29e907dd8acd8828baa6cabd8ab979f92f658 WatchSource:0}: Error finding container 560ad6ed38d84fcc722ebb29b4c29e907dd8acd8828baa6cabd8ab979f92f658: Status 404 returned error can't find the container with id 560ad6ed38d84fcc722ebb29b4c29e907dd8acd8828baa6cabd8ab979f92f658 Sep 18 13:19:13.972870 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.972850 2580 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-driver start failed in pod aws-ebs-csi-driver-node-vhvcn_openshift-cluster-csi-drivers(546cf32c-d65c-47d1-bfa7-b4fd391638eb): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Sep 18 13:19:13.973506 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.973490 2580 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-node-driver-registrar start failed in pod aws-ebs-csi-driver-node-vhvcn_openshift-cluster-csi-drivers(546cf32c-d65c-47d1-bfa7-b4fd391638eb): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Sep 18 13:19:13.975216 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.975200 2580 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-liveness-probe start failed in pod aws-ebs-csi-driver-node-vhvcn_openshift-cluster-csi-drivers(546cf32c-d65c-47d1-bfa7-b4fd391638eb): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Sep 18 13:19:13.975265 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:13.975241 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"csi-driver\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"csi-liveness-probe\" with ErrImagePull: \"pull QPS exceeded\"]" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" podUID="546cf32c-d65c-47d1-bfa7-b4fd391638eb" Sep 18 13:19:14.230885 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.230849 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:14.231039 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.230888 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:14.231039 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.230935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8br\" (UniqueName: \"kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br\") pod \"network-check-target-f9l47\" (UID: \"d7ecc191-ecaa-4911-9fbd-3150a630dba6\") " pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:14.231039 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:14.230982 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:14.231039 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:14.231028 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:14.231165 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:14.231051 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs podName:7e79de33-0f2f-4207-9ea9-276b1f3744f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:15.231032884 +0000 UTC m=+4.740671237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs") pod "network-metrics-daemon-mkf52" (UID: "7e79de33-0f2f-4207-9ea9-276b1f3744f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:14.231165 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:14.231078 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret podName:0361a153-89d1-45d7-a84f-a3fcd4368a2c nodeName:}" failed. No retries permitted until 2026-09-18 13:19:15.231066314 +0000 UTC m=+4.740704658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret") pod "global-pull-secret-syncer-zjkgw" (UID: "0361a153-89d1-45d7-a84f-a3fcd4368a2c") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:14.231165 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:14.231029 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:19:14.231165 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:14.231101 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:19:14.231165 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:14.231113 2580 projected.go:196] Error preparing data for projected volume kube-api-access-4k8br for pod openshift-network-diagnostics/network-check-target-f9l47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:14.231165 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:14.231150 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br podName:d7ecc191-ecaa-4911-9fbd-3150a630dba6 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:15.231140054 +0000 UTC m=+4.740778414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k8br" (UniqueName: "kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br") pod "network-check-target-f9l47" (UID: "d7ecc191-ecaa-4911-9fbd-3150a630dba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:14.600849 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.600785 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:14:13 +0000 UTC" deadline="2028-03-29 10:00:57.372051061 +0000 UTC" Sep 18 13:19:14.600849 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.600846 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13388h41m42.771208719s" Sep 18 13:19:14.642241 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.642122 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-br5x2" event={"ID":"8e696015-7fc3-4280-852c-9929002e2dbf","Type":"ContainerStarted","Data":"f53754980b1bddb9ef1f74834aa901c23cbcc2ed11619a5d501dccdc1aa97df2"} Sep 18 13:19:14.647661 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.647628 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-npfmn" event={"ID":"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7","Type":"ContainerStarted","Data":"0f602b68d027fdc60fa3935136a7952e924644e08d495e11fe044e77bc84bcbc"} Sep 18 13:19:14.661817 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.661785 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" event={"ID":"1090a9ee-3fad-4085-b97f-bae07eef0fc3","Type":"ContainerStarted","Data":"bc883ddeec4d7369beb7ee5fe4ff6a3ee64ee48d4e6446b652388f4fe5c6b2c1"} Sep 18 13:19:14.673814 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.673787 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tz7qx" event={"ID":"322730aa-4fe2-413f-9df6-8249b41758ee","Type":"ContainerStarted","Data":"206175c70103c37cfa5660f84a413c55cc276b1228b3507f7a30a983d039036a"} Sep 18 13:19:14.678496 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.678449 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hh48c" event={"ID":"7b916f67-d86f-4473-8c30-fc5a908e8dd2","Type":"ContainerStarted","Data":"622b12240b75df8cb3e1a3434f69fee0b2de552524fbd4679fc3cd726ca097d6"} Sep 18 13:19:14.690344 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.690317 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6q8gw" event={"ID":"7a2d3146-c0f0-48bc-822e-c7300770ebe6","Type":"ContainerStarted","Data":"6fd4d0efa9fd661a4906c5558de61e5616f164bce8f584ff9aaa6c4ba4350a15"} Sep 18 13:19:14.697483 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.697374 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" event={"ID":"19ae1cf8d903f126afc3c86c6cfdbd16","Type":"ContainerStarted","Data":"aa089c9b75defbe63a4667da4922253fe6f472de204bdde2680afcded3ecbada"} Sep 18 13:19:14.725028 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.724998 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" event={"ID":"66735a565a3af6f436b6c35ffc205408","Type":"ContainerStarted","Data":"a471e053a754c953f63be034db3fc3eed3675438c2e8a4d25da043701243e7c7"} Sep 18 13:19:14.741977 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.740960 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" event={"ID":"546cf32c-d65c-47d1-bfa7-b4fd391638eb","Type":"ContainerStarted","Data":"560ad6ed38d84fcc722ebb29b4c29e907dd8acd8828baa6cabd8ab979f92f658"} Sep 18 13:19:14.755729 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:14.755677 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"csi-driver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d3869c161a073dfbaf036364ff0996f20e4d9ee240af9f0daa929f78c7ea46e\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:54fc81b7047fca86ea91318cae087e3f654cc8d54725953ea6f0ddfcaf515545\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"csi-liveness-probe\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c43eb8f4e3024c90d819ecdc6c4101d91bd5c368d5b50945756ddf6fa4b3b9cf\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" podUID="546cf32c-d65c-47d1-bfa7-b4fd391638eb" Sep 18 13:19:14.756995 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.756967 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c9xcg" event={"ID":"380ff550-0e7a-46ea-a947-9fff416d9181","Type":"ContainerStarted","Data":"ab8dc6f78d84d76d6db1bdc3ba7423d5569075f3418eddc9dcb6c7366d65d3a9"} Sep 18 13:19:14.766490 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.766462 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" event={"ID":"6735cebf-aaab-4717-b5e3-d729b812b2dd","Type":"ContainerStarted","Data":"c95e50172108362879fb9016e77984f962173bff30d696d9d7123934b9130b9a"} Sep 18 13:19:14.932711 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:14.932633 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:15.238783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8br\" (UniqueName: \"kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br\") pod \"network-check-target-f9l47\" (UID: \"d7ecc191-ecaa-4911-9fbd-3150a630dba6\") " pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:15.238869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:15.238912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.239061 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.239138 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret podName:0361a153-89d1-45d7-a84f-a3fcd4368a2c nodeName:}" failed. No retries permitted until 2026-09-18 13:19:17.23910292 +0000 UTC m=+6.748741271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret") pod "global-pull-secret-syncer-zjkgw" (UID: "0361a153-89d1-45d7-a84f-a3fcd4368a2c") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.239548 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.239571 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.239584 2580 projected.go:196] Error preparing data for projected volume kube-api-access-4k8br for pod openshift-network-diagnostics/network-check-target-f9l47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.239629 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br podName:d7ecc191-ecaa-4911-9fbd-3150a630dba6 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:17.239614811 +0000 UTC m=+6.749253161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k8br" (UniqueName: "kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br") pod "network-check-target-f9l47" (UID: "d7ecc191-ecaa-4911-9fbd-3150a630dba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.239690 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:15.239813 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.239737 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs podName:7e79de33-0f2f-4207-9ea9-276b1f3744f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:17.239710781 +0000 UTC m=+6.749349126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs") pod "network-metrics-daemon-mkf52" (UID: "7e79de33-0f2f-4207-9ea9-276b1f3744f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:15.601663 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:15.601598 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:14:13 +0000 UTC" deadline="2028-03-13 23:20:04.127918193 +0000 UTC" Sep 18 13:19:15.601663 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:15.601632 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13018h0m48.526290438s" Sep 18 13:19:15.620694 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:15.620640 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:15.620858 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.620772 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:15.621117 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:15.621087 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:15.621184 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:15.621132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:15.621242 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.621212 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:15.621349 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:15.621305 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:17.256998 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:17.256956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8br\" (UniqueName: \"kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br\") pod \"network-check-target-f9l47\" (UID: \"d7ecc191-ecaa-4911-9fbd-3150a630dba6\") " pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:17.257453 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:17.257055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:17.257453 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:17.257300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:17.259637 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.259571 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:19:17.259637 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.259599 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:19:17.259637 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.259616 2580 projected.go:196] Error preparing data for projected volume kube-api-access-4k8br for pod openshift-network-diagnostics/network-check-target-f9l47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:17.259879 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.259670 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br podName:d7ecc191-ecaa-4911-9fbd-3150a630dba6 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:21.259649255 +0000 UTC m=+10.769287604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k8br" (UniqueName: "kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br") pod "network-check-target-f9l47" (UID: "d7ecc191-ecaa-4911-9fbd-3150a630dba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:17.260256 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.260239 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:17.260333 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.260307 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs podName:7e79de33-0f2f-4207-9ea9-276b1f3744f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:21.260289775 +0000 UTC m=+10.769928124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs") pod "network-metrics-daemon-mkf52" (UID: "7e79de33-0f2f-4207-9ea9-276b1f3744f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:17.260521 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.260506 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:17.260594 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.260577 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret podName:0361a153-89d1-45d7-a84f-a3fcd4368a2c nodeName:}" failed. No retries permitted until 2026-09-18 13:19:21.260544075 +0000 UTC m=+10.770182420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret") pod "global-pull-secret-syncer-zjkgw" (UID: "0361a153-89d1-45d7-a84f-a3fcd4368a2c") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:17.620624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:17.620435 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:17.620624 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.620567 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:17.620885 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:17.620734 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:17.620885 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.620849 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:17.620885 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:17.620877 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:17.620993 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:17.620952 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:19.620281 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:19.619961 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:19.620281 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:19.619984 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:19.620281 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:19.619965 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:19.620281 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:19.620087 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:19.620281 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:19.620208 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:19.620915 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:19.620290 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:21.290755 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:21.290703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:21.291236 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:21.290800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8br\" (UniqueName: \"kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br\") pod \"network-check-target-f9l47\" (UID: \"d7ecc191-ecaa-4911-9fbd-3150a630dba6\") " pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:21.291236 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:21.290839 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:21.291236 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.290983 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:21.291236 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.291046 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs podName:7e79de33-0f2f-4207-9ea9-276b1f3744f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:29.291026665 +0000 UTC m=+18.800665029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs") pod "network-metrics-daemon-mkf52" (UID: "7e79de33-0f2f-4207-9ea9-276b1f3744f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:21.291236 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.291073 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:21.291236 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.291133 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret podName:0361a153-89d1-45d7-a84f-a3fcd4368a2c nodeName:}" failed. No retries permitted until 2026-09-18 13:19:29.291117298 +0000 UTC m=+18.800755659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret") pod "global-pull-secret-syncer-zjkgw" (UID: "0361a153-89d1-45d7-a84f-a3fcd4368a2c") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:21.291236 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.291193 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:19:21.291236 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.291234 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:19:21.291618 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.291248 2580 projected.go:196] Error preparing data for projected volume kube-api-access-4k8br for pod openshift-network-diagnostics/network-check-target-f9l47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:21.291618 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.291292 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br podName:d7ecc191-ecaa-4911-9fbd-3150a630dba6 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:29.291279194 +0000 UTC m=+18.800917558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k8br" (UniqueName: "kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br") pod "network-check-target-f9l47" (UID: "d7ecc191-ecaa-4911-9fbd-3150a630dba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:21.620011 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:21.619970 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:21.620235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:21.620101 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:21.620235 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.620104 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:21.620235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:21.620125 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:21.620235 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.620223 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:21.620532 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:21.620321 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:23.620136 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:23.620098 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:23.620136 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:23.620127 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:23.620648 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:23.620098 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:23.620648 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:23.620239 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:23.620648 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:23.620300 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:23.620648 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:23.620383 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:25.620314 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:25.620280 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:25.620945 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:25.620283 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:25.620945 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:25.620412 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:25.620945 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:25.620480 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:25.620945 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:25.620293 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:25.620945 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:25.620580 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:27.619786 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:27.619755 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:27.620191 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:27.619968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:27.620191 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:27.620005 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:27.620191 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:27.620080 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:27.620191 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:27.620107 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:27.620191 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:27.620150 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:29.344979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:29.344940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8br\" (UniqueName: \"kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br\") pod \"network-check-target-f9l47\" (UID: \"d7ecc191-ecaa-4911-9fbd-3150a630dba6\") " pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:29.345416 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:29.344997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:29.345416 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:29.345031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:29.345416 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.345130 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:19:29.345416 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.345151 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:19:29.345416 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.345156 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:29.345416 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.345165 2580 projected.go:196] Error preparing data for projected volume kube-api-access-4k8br for pod openshift-network-diagnostics/network-check-target-f9l47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:29.345416 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.345156 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:29.345416 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.345220 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret podName:0361a153-89d1-45d7-a84f-a3fcd4368a2c nodeName:}" failed. No retries permitted until 2026-09-18 13:19:45.345198891 +0000 UTC m=+34.854837259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret") pod "global-pull-secret-syncer-zjkgw" (UID: "0361a153-89d1-45d7-a84f-a3fcd4368a2c") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:29.345416 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.345246 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs podName:7e79de33-0f2f-4207-9ea9-276b1f3744f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:45.345226737 +0000 UTC m=+34.854865088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs") pod "network-metrics-daemon-mkf52" (UID: "7e79de33-0f2f-4207-9ea9-276b1f3744f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:29.345416 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.345271 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br podName:d7ecc191-ecaa-4911-9fbd-3150a630dba6 nodeName:}" failed. No retries permitted until 2026-09-18 13:19:45.345261554 +0000 UTC m=+34.854899899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k8br" (UniqueName: "kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br") pod "network-check-target-f9l47" (UID: "d7ecc191-ecaa-4911-9fbd-3150a630dba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:29.620990 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:29.620704 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:29.620990 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:29.620768 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:29.620990 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.620837 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:29.620990 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:29.620771 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:29.620990 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.620899 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:29.620990 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:29.620956 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:31.619984 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:31.619957 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:31.620409 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:31.619960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:31.620409 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:31.620046 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:31.620409 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:31.619960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:31.620409 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:31.620126 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:31.620409 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:31.620201 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:32.635136 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:32.634711 2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ae1cf8d903f126afc3c86c6cfdbd16.slice/crio-conmon-1b79c1fb267c6c82a24e0f24baae6b3adce5d765a7006655d155b86cc8a15eae.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ae1cf8d903f126afc3c86c6cfdbd16.slice/crio-1b79c1fb267c6c82a24e0f24baae6b3adce5d765a7006655d155b86cc8a15eae.scope\": RecentStats: unable to find data in memory cache]" Sep 18 13:19:32.821787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.821744 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c9xcg" event={"ID":"380ff550-0e7a-46ea-a947-9fff416d9181","Type":"ContainerStarted","Data":"e81f804ee5778ab3731c309674aedb78eca604566c91720c2995880d307901bd"} Sep 18 13:19:32.824569 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.824540 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" event={"ID":"6735cebf-aaab-4717-b5e3-d729b812b2dd","Type":"ContainerStarted","Data":"48e8eed4188fa462f1e346418f3960139071b5a25ba53ed8e47507664911751e"} Sep 18 13:19:32.824701 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.824617 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" event={"ID":"6735cebf-aaab-4717-b5e3-d729b812b2dd","Type":"ContainerStarted","Data":"ec712ebe259e0f4334aa9a8b12c2ec5282bd48cf19df8b4aa9178c42079e4426"} Sep 18 13:19:32.824701 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.824665 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" event={"ID":"6735cebf-aaab-4717-b5e3-d729b812b2dd","Type":"ContainerStarted","Data":"f9e2830e9a82cfe8f568e9bf2fa7b1a2c2adfb1e75fd594b85268cfc2e2fa59b"} Sep 18 13:19:32.824822 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.824731 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" event={"ID":"6735cebf-aaab-4717-b5e3-d729b812b2dd","Type":"ContainerStarted","Data":"1b5abb1fd66b8770638a77b23a6f96f62e43cf0780e5938d350374e5c856f26f"} Sep 18 13:19:32.826221 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.826195 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-br5x2" event={"ID":"8e696015-7fc3-4280-852c-9929002e2dbf","Type":"ContainerStarted","Data":"ac965bfd3c5181746f7e314ca2b5832763d1a1ad294e0bf5a15f7dee661153fd"} Sep 18 13:19:32.827815 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.827786 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-npfmn" event={"ID":"4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7","Type":"ContainerStarted","Data":"b075339e45f825489cb096bef36d7f8d03131cca146c2637651fd10d40af63ab"} Sep 18 13:19:32.829321 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.829298 2580 generic.go:356] "Generic (PLEG): container finished" podID="1090a9ee-3fad-4085-b97f-bae07eef0fc3" containerID="46060130dfbbf5055c7f8945762ae4d2f9d0d3864d23cc29c37a61574e41dd89" exitCode=0 Sep 18 13:19:32.829442 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.829336 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" event={"ID":"1090a9ee-3fad-4085-b97f-bae07eef0fc3","Type":"ContainerDied","Data":"46060130dfbbf5055c7f8945762ae4d2f9d0d3864d23cc29c37a61574e41dd89"} Sep 18 13:19:32.830979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.830891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tz7qx" event={"ID":"322730aa-4fe2-413f-9df6-8249b41758ee","Type":"ContainerStarted","Data":"44fefb9deaeee38dda764fec0b06e2e29eb2197a529c349201eb1d68a1b2bd07"} Sep 18 13:19:32.832805 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.832783 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hh48c" event={"ID":"7b916f67-d86f-4473-8c30-fc5a908e8dd2","Type":"ContainerStarted","Data":"6c81287d186a628b454f5e5d202452e8efddb08951b01ad74ada0c7ca8d08c09"} Sep 18 13:19:32.834409 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.834389 2580 generic.go:356] "Generic (PLEG): container finished" podID="19ae1cf8d903f126afc3c86c6cfdbd16" containerID="1b79c1fb267c6c82a24e0f24baae6b3adce5d765a7006655d155b86cc8a15eae" exitCode=0 Sep 18 13:19:32.834515 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.834455 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" event={"ID":"19ae1cf8d903f126afc3c86c6cfdbd16","Type":"ContainerDied","Data":"1b79c1fb267c6c82a24e0f24baae6b3adce5d765a7006655d155b86cc8a15eae"} Sep 18 13:19:32.836060 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.836004 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" event={"ID":"66735a565a3af6f436b6c35ffc205408","Type":"ContainerStarted","Data":"06260b744fc303f32b378b6fdbf10c23b4f1950607c52185e1f71ae445263036"} Sep 18 13:19:32.838463 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.838420 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c9xcg" podStartSLOduration=1.892886101 podStartE2EDuration="19.838404793s" totalImagesPullingTime="17.945518692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:32.837771088 +0000 UTC m=+22.347409476" watchObservedRunningTime="2026-09-18 13:19:32.838404793 +0000 UTC m=+22.348043164" Sep 18 13:19:32.853065 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.853022 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-232.ec2.internal" podStartSLOduration=19.853005804 podStartE2EDuration="19.853005804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:32.85285282 +0000 UTC m=+22.362491185" watchObservedRunningTime="2026-09-18 13:19:32.853005804 +0000 UTC m=+22.362644197" Sep 18 13:19:32.888639 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.888591 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hh48c" podStartSLOduration=2.874623476 podStartE2EDuration="20.888573745s" totalImagesPullingTime="18.013950269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:32.871545089 +0000 UTC m=+22.381183456" watchObservedRunningTime="2026-09-18 13:19:32.888573745 +0000 UTC m=+22.398212103" Sep 18 13:19:32.919937 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.919894 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tz7qx" podStartSLOduration=2.925229324 podStartE2EDuration="20.91987632s" totalImagesPullingTime="17.994646996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:32.887787411 +0000 UTC m=+22.397425818" watchObservedRunningTime="2026-09-18 13:19:32.91987632 +0000 UTC m=+22.429514685" Sep 18 13:19:32.920148 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.920121 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-npfmn" podStartSLOduration=2.90843102 podStartE2EDuration="20.920111939s" totalImagesPullingTime="18.011680919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:32.919399179 +0000 UTC m=+22.429037546" watchObservedRunningTime="2026-09-18 13:19:32.920111939 +0000 UTC m=+22.429750322" Sep 18 13:19:32.968645 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:32.968603 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-br5x2" podStartSLOduration=2.027314873 podStartE2EDuration="19.968591187s" totalImagesPullingTime="17.941276314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:32.968039231 +0000 UTC m=+22.477677614" watchObservedRunningTime="2026-09-18 13:19:32.968591187 +0000 UTC m=+22.478229552" Sep 18 13:19:33.620411 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:33.620200 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:33.620503 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:33.620222 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:33.620568 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:33.620515 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:33.620628 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:33.620271 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:33.620628 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:33.620593 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:33.620761 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:33.620710 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:33.843100 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:33.842600 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6q8gw" event={"ID":"7a2d3146-c0f0-48bc-822e-c7300770ebe6","Type":"ContainerStarted","Data":"d2d6fc8f602752e4695e05afa9204f9c426643e935130ab141d61b7568bf0b16"} Sep 18 13:19:33.844992 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:33.844948 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" event={"ID":"19ae1cf8d903f126afc3c86c6cfdbd16","Type":"ContainerStarted","Data":"3146450408c02671ff480057f24bf2920742ae77d51c6a6d21074e554c453891"} Sep 18 13:19:33.846705 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:33.846644 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" event={"ID":"546cf32c-d65c-47d1-bfa7-b4fd391638eb","Type":"ContainerStarted","Data":"45b92e8d699772a82017717a2ac6605814412a44c6ba1fd128580c43ceb608c6"} Sep 18 13:19:33.849867 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:33.849841 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" event={"ID":"6735cebf-aaab-4717-b5e3-d729b812b2dd","Type":"ContainerStarted","Data":"ef2e2d3d6179bd9b02ef4274bfa033ec3b1a87c21ed7e8c4357b338a0a3d90a7"} Sep 18 13:19:33.849986 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:33.849922 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" event={"ID":"6735cebf-aaab-4717-b5e3-d729b812b2dd","Type":"ContainerStarted","Data":"363a088d2201b994071deae8b0f11431d117d30a0ac9bb1baf808366ee3a7441"} Sep 18 13:19:33.858484 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:33.858439 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6q8gw" podStartSLOduration=3.829057299 podStartE2EDuration="21.85842254s" totalImagesPullingTime="18.029365241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:33.857827886 +0000 UTC m=+23.367466252" watchObservedRunningTime="2026-09-18 13:19:33.85842254 +0000 UTC m=+23.368060910" Sep 18 13:19:33.874666 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:33.874620 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-232.ec2.internal" podStartSLOduration=20.874603844 podStartE2EDuration="20.874603844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:33.874364299 +0000 UTC m=+23.384002666" watchObservedRunningTime="2026-09-18 13:19:33.874603844 +0000 UTC m=+23.384242226" Sep 18 13:19:34.542171 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:34.542142 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 13:19:34.606409 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:34.606286 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T13:19:34.542156867Z","UUID":"f779347c-ac25-4f87-af23-697c834cd18c","Handler":null,"Name":"","Endpoint":""} Sep 18 13:19:34.608803 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:34.608784 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 13:19:34.608892 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:34.608816 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 13:19:34.854074 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:34.854036 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" event={"ID":"546cf32c-d65c-47d1-bfa7-b4fd391638eb","Type":"ContainerStarted","Data":"ff13edf06ba876a095a5e15702a70713c105bf47744c398f4612ccc8914b606c"} Sep 18 13:19:35.404653 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:35.404624 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:35.405296 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:35.405261 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:35.619835 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:35.619809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:35.619982 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:35.619896 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:35.619982 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:35.619901 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:35.619982 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:35.619925 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:35.620083 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:35.619998 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:35.620083 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:35.620068 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:35.859589 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:35.859544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" event={"ID":"546cf32c-d65c-47d1-bfa7-b4fd391638eb","Type":"ContainerStarted","Data":"04d4ea15839c8f999757c07f5a670e5fee9a312cdc50d42c6a6168f8de9fd6f5"} Sep 18 13:19:35.863473 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:35.863447 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" event={"ID":"6735cebf-aaab-4717-b5e3-d729b812b2dd","Type":"ContainerStarted","Data":"2cff065e840b27ac65c0e6ac1db60e20e7cbe0998c263d123ac5f5615e1332ef"} Sep 18 13:19:35.863619 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:35.863549 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:35.864135 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:35.864116 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-br5x2" Sep 18 13:19:35.918452 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:35.918400 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhvcn" podStartSLOduration=1.5131712400000001 podStartE2EDuration="22.918384771s" totalImagesPullingTime="21.405213531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=3 observedRunningTime="2026-09-18 13:19:35.918219108 +0000 UTC m=+25.427857474" watchObservedRunningTime="2026-09-18 13:19:35.918384771 +0000 UTC m=+25.428023165" Sep 18 13:19:37.620212 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:37.620181 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:37.620735 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:37.620181 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:37.620735 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:37.620306 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:37.620735 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:37.620309 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:37.620735 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:37.620391 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:37.620735 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:37.620475 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:37.872649 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:37.872350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" event={"ID":"6735cebf-aaab-4717-b5e3-d729b812b2dd","Type":"ContainerStarted","Data":"d93062e7da0e02e43bdc8bf1fce13b2f35957a7f334678a393ee9fc405d06d0d"} Sep 18 13:19:37.872731 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:37.872648 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:37.887962 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:37.887862 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:37.904270 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:37.904226 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" podStartSLOduration=6.488915678 podStartE2EDuration="24.904213161s" totalImagesPullingTime="18.415297483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:37.903918151 +0000 UTC m=+27.413556517" watchObservedRunningTime="2026-09-18 13:19:37.904213161 +0000 UTC m=+27.413851527" Sep 18 13:19:38.875967 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:38.875935 2580 generic.go:356] "Generic (PLEG): container finished" podID="1090a9ee-3fad-4085-b97f-bae07eef0fc3" containerID="5d155d33b1cf7dd36fdec64cf8ecb91c9545f40b2b43a70278f2b0fe17dfb518" exitCode=0 Sep 18 13:19:38.876484 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:38.876027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" event={"ID":"1090a9ee-3fad-4085-b97f-bae07eef0fc3","Type":"ContainerDied","Data":"5d155d33b1cf7dd36fdec64cf8ecb91c9545f40b2b43a70278f2b0fe17dfb518"} Sep 18 13:19:38.876484 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:38.876422 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:38.876611 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:38.876503 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:38.891615 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:38.891594 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:19:39.619835 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.619808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:39.619955 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.619808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:39.619955 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:39.619909 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:39.620043 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:39.620020 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:39.620088 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.619808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:39.620147 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:39.620131 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:39.810044 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.810017 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f9l47"] Sep 18 13:19:39.813174 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.813146 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mkf52"] Sep 18 13:19:39.813671 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.813651 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zjkgw"] Sep 18 13:19:39.880490 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.880466 2580 generic.go:356] "Generic (PLEG): container finished" podID="1090a9ee-3fad-4085-b97f-bae07eef0fc3" containerID="76b1794db2d1fcc61c9744a9271140623f2120c50959ba32c7bb257da7d90000" exitCode=0 Sep 18 13:19:39.880992 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.880530 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:39.880992 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.880553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" event={"ID":"1090a9ee-3fad-4085-b97f-bae07eef0fc3","Type":"ContainerDied","Data":"76b1794db2d1fcc61c9744a9271140623f2120c50959ba32c7bb257da7d90000"} Sep 18 13:19:39.880992 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:39.880697 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:39.880992 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.880770 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:39.880992 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:39.880854 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:39.881454 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:39.881237 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:39.881454 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:39.881362 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:40.884882 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:40.884849 2580 generic.go:356] "Generic (PLEG): container finished" podID="1090a9ee-3fad-4085-b97f-bae07eef0fc3" containerID="818bf784f2f94c2d5f9aa0ce6eb172dee1c7ffdfb6ee3b3b9a0afe947605b954" exitCode=0 Sep 18 13:19:40.885251 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:40.884934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" event={"ID":"1090a9ee-3fad-4085-b97f-bae07eef0fc3","Type":"ContainerDied","Data":"818bf784f2f94c2d5f9aa0ce6eb172dee1c7ffdfb6ee3b3b9a0afe947605b954"} Sep 18 13:19:41.620220 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:41.620182 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:41.620399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:41.620182 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:41.620399 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:41.620308 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:41.620399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:41.620187 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:41.620557 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:41.620406 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:41.620557 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:41.620466 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:43.619900 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:43.619674 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:43.620346 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:43.619700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:43.620346 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:43.620003 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:43.620346 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:43.620056 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:43.620346 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:43.619708 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:43.620495 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:43.620134 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:45.370670 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.370646 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8br\" (UniqueName: \"kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br\") pod \"network-check-target-f9l47\" (UID: \"d7ecc191-ecaa-4911-9fbd-3150a630dba6\") " pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:45.370966 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.370679 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:45.370966 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.370703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:45.370966 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.370802 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:45.370966 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.370807 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:45.370966 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.370823 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:19:45.370966 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.370839 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:19:45.370966 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.370844 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret podName:0361a153-89d1-45d7-a84f-a3fcd4368a2c nodeName:}" failed. No retries permitted until 2026-09-18 13:20:17.370832566 +0000 UTC m=+66.880470911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret") pod "global-pull-secret-syncer-zjkgw" (UID: "0361a153-89d1-45d7-a84f-a3fcd4368a2c") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:19:45.370966 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.370850 2580 projected.go:196] Error preparing data for projected volume kube-api-access-4k8br for pod openshift-network-diagnostics/network-check-target-f9l47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:45.370966 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.370866 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs podName:7e79de33-0f2f-4207-9ea9-276b1f3744f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:17.370851469 +0000 UTC m=+66.880489813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs") pod "network-metrics-daemon-mkf52" (UID: "7e79de33-0f2f-4207-9ea9-276b1f3744f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:19:45.370966 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.370896 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br podName:d7ecc191-ecaa-4911-9fbd-3150a630dba6 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:17.370880566 +0000 UTC m=+66.880518924 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k8br" (UniqueName: "kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br") pod "network-check-target-f9l47" (UID: "d7ecc191-ecaa-4911-9fbd-3150a630dba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:19:45.619745 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.619670 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:45.619745 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.619704 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:45.619913 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.619788 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:45.619913 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.619812 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjkgw" podUID="0361a153-89d1-45d7-a84f-a3fcd4368a2c" Sep 18 13:19:45.619913 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.619869 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkf52" podUID="7e79de33-0f2f-4207-9ea9-276b1f3744f2" Sep 18 13:19:45.620057 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:45.619913 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9l47" podUID="d7ecc191-ecaa-4911-9fbd-3150a630dba6" Sep 18 13:19:45.886376 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.886322 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-232.ec2.internal" event="NodeReady" Sep 18 13:19:45.886477 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.886422 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 13:19:45.899132 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.899107 2580 generic.go:356] "Generic (PLEG): container finished" podID="1090a9ee-3fad-4085-b97f-bae07eef0fc3" containerID="e99fed1d1831e358a78d3e8adecd51c4820e32947cb1c29d92f61ff5f96bb612" exitCode=0 Sep 18 13:19:45.899234 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.899172 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" event={"ID":"1090a9ee-3fad-4085-b97f-bae07eef0fc3","Type":"ContainerDied","Data":"e99fed1d1831e358a78d3e8adecd51c4820e32947cb1c29d92f61ff5f96bb612"} Sep 18 13:19:45.928284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.928263 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b848d8c94-2k2x9"] Sep 18 13:19:45.944118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.944096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:45.946812 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.946789 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 13:19:45.946911 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.946879 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j6lw2\"" Sep 18 13:19:45.947059 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.947044 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 13:19:45.947105 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.947044 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 13:19:45.950097 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.950067 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q5s2h"] Sep 18 13:19:45.956890 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.953393 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 13:19:45.968890 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.968871 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tvqnd"] Sep 18 13:19:45.969008 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.968992 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:45.972819 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.972793 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 13:19:45.973124 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.973107 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 13:19:45.973193 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.973108 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tljtf\"" Sep 18 13:19:45.987123 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.987079 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b848d8c94-2k2x9"] Sep 18 13:19:45.987123 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.987109 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tvqnd"] Sep 18 13:19:45.987123 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.987125 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q5s2h"] Sep 18 13:19:45.987334 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.987142 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tvqnd" Sep 18 13:19:45.993168 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.993151 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 13:19:45.993265 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.993170 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 13:19:45.993403 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.993389 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gj6zn\"" Sep 18 13:19:45.993473 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:45.993451 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 13:19:46.074932 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.074910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-image-registry-private-configuration\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.075022 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.074942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.075022 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.074968 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-installation-pull-secrets\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.075110 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbab27f6-d66f-44e0-9a48-556495083572-cert\") pod \"ingress-canary-tvqnd\" (UID: \"dbab27f6-d66f-44e0-9a48-556495083572\") " pod="openshift-ingress-canary/ingress-canary-tvqnd" Sep 18 13:19:46.075110 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-bound-sa-token\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.075110 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/211a7909-2eed-45a3-b415-7fdb59b6de1e-config-volume\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.075110 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075078 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rd4z\" (UniqueName: \"kubernetes.io/projected/211a7909-2eed-45a3-b415-7fdb59b6de1e-kube-api-access-2rd4z\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.075309 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075110 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrhpd\" (UniqueName: \"kubernetes.io/projected/dbab27f6-d66f-44e0-9a48-556495083572-kube-api-access-vrhpd\") pod \"ingress-canary-tvqnd\" (UID: \"dbab27f6-d66f-44e0-9a48-556495083572\") " pod="openshift-ingress-canary/ingress-canary-tvqnd" Sep 18 13:19:46.075309 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-certificates\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.075309 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-trusted-ca\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.075309 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.075309 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2efc3662-9438-4c9a-8d83-258d5fe21c8f-ca-trust-extracted\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.075486 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5g5h\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-kube-api-access-p5g5h\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.075486 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.075333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/211a7909-2eed-45a3-b415-7fdb59b6de1e-tmp-dir\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.175991 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.175969 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.176099 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2efc3662-9438-4c9a-8d83-258d5fe21c8f-ca-trust-extracted\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.176099 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5g5h\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-kube-api-access-p5g5h\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.176099 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176069 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/211a7909-2eed-45a3-b415-7fdb59b6de1e-tmp-dir\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.176247 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-image-registry-private-configuration\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.176247 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:46.176115 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:19:46.176247 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:46.176135 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b848d8c94-2k2x9: secret "image-registry-tls" not found Sep 18 13:19:46.176247 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.176247 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-installation-pull-secrets\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.176247 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:46.176195 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls podName:2efc3662-9438-4c9a-8d83-258d5fe21c8f nodeName:}" failed. No retries permitted until 2026-09-18 13:19:46.676176003 +0000 UTC m=+36.185814355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls") pod "image-registry-7b848d8c94-2k2x9" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f") : secret "image-registry-tls" not found Sep 18 13:19:46.176247 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbab27f6-d66f-44e0-9a48-556495083572-cert\") pod \"ingress-canary-tvqnd\" (UID: \"dbab27f6-d66f-44e0-9a48-556495083572\") " pod="openshift-ingress-canary/ingress-canary-tvqnd" Sep 18 13:19:46.176583 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176264 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-bound-sa-token\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.176583 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/211a7909-2eed-45a3-b415-7fdb59b6de1e-config-volume\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.176583 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:46.176268 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:19:46.176583 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176410 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/211a7909-2eed-45a3-b415-7fdb59b6de1e-tmp-dir\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.176583 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:46.176442 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls podName:211a7909-2eed-45a3-b415-7fdb59b6de1e nodeName:}" failed. No retries permitted until 2026-09-18 13:19:46.676423345 +0000 UTC m=+36.186061689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls") pod "dns-default-q5s2h" (UID: "211a7909-2eed-45a3-b415-7fdb59b6de1e") : secret "dns-default-metrics-tls" not found Sep 18 13:19:46.176583 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176438 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2efc3662-9438-4c9a-8d83-258d5fe21c8f-ca-trust-extracted\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.176887 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rd4z\" (UniqueName: \"kubernetes.io/projected/211a7909-2eed-45a3-b415-7fdb59b6de1e-kube-api-access-2rd4z\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.176931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/211a7909-2eed-45a3-b415-7fdb59b6de1e-config-volume\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.176965 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrhpd\" (UniqueName: \"kubernetes.io/projected/dbab27f6-d66f-44e0-9a48-556495083572-kube-api-access-vrhpd\") pod \"ingress-canary-tvqnd\" (UID: \"dbab27f6-d66f-44e0-9a48-556495083572\") " pod="openshift-ingress-canary/ingress-canary-tvqnd" Sep 18 13:19:46.177016 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.176999 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-certificates\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.177063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.177023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-trusted-ca\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.177554 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.177533 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-certificates\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.178046 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.178027 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-trusted-ca\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.180091 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.180071 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-installation-pull-secrets\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.180253 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.180235 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-image-registry-private-configuration\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.180292 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.180235 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbab27f6-d66f-44e0-9a48-556495083572-cert\") pod \"ingress-canary-tvqnd\" (UID: \"dbab27f6-d66f-44e0-9a48-556495083572\") " pod="openshift-ingress-canary/ingress-canary-tvqnd" Sep 18 13:19:46.191018 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.190998 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rd4z\" (UniqueName: \"kubernetes.io/projected/211a7909-2eed-45a3-b415-7fdb59b6de1e-kube-api-access-2rd4z\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.192554 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.192531 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrhpd\" (UniqueName: \"kubernetes.io/projected/dbab27f6-d66f-44e0-9a48-556495083572-kube-api-access-vrhpd\") pod \"ingress-canary-tvqnd\" (UID: \"dbab27f6-d66f-44e0-9a48-556495083572\") " pod="openshift-ingress-canary/ingress-canary-tvqnd" Sep 18 13:19:46.193072 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.193054 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-bound-sa-token\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.194343 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.194321 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5g5h\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-kube-api-access-p5g5h\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.244824 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.244785 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:46.297049 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.297029 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tvqnd" Sep 18 13:19:46.452707 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.452506 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:46.603206 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.603177 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tvqnd"] Sep 18 13:19:46.606944 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:19:46.606919 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbab27f6_d66f_44e0_9a48_556495083572.slice/crio-78411957d67a18a4e64769a2a1ed7fd0da32a8b5171cd79d49e43b0ef5ac6dd4 WatchSource:0}: Error finding container 78411957d67a18a4e64769a2a1ed7fd0da32a8b5171cd79d49e43b0ef5ac6dd4: Status 404 returned error can't find the container with id 78411957d67a18a4e64769a2a1ed7fd0da32a8b5171cd79d49e43b0ef5ac6dd4 Sep 18 13:19:46.680533 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.680512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:46.680645 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.680554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:46.680684 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:46.680658 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:19:46.680684 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:46.680675 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b848d8c94-2k2x9: secret "image-registry-tls" not found Sep 18 13:19:46.680764 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:46.680685 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:19:46.680764 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:46.680737 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls podName:2efc3662-9438-4c9a-8d83-258d5fe21c8f nodeName:}" failed. No retries permitted until 2026-09-18 13:19:47.680708603 +0000 UTC m=+37.190346964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls") pod "image-registry-7b848d8c94-2k2x9" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f") : secret "image-registry-tls" not found Sep 18 13:19:46.680764 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:46.680753 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls podName:211a7909-2eed-45a3-b415-7fdb59b6de1e nodeName:}" failed. No retries permitted until 2026-09-18 13:19:47.680747498 +0000 UTC m=+37.190385842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls") pod "dns-default-q5s2h" (UID: "211a7909-2eed-45a3-b415-7fdb59b6de1e") : secret "dns-default-metrics-tls" not found Sep 18 13:19:46.784215 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.784145 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:46.885811 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.885781 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:46.902775 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.902751 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tvqnd" event={"ID":"dbab27f6-d66f-44e0-9a48-556495083572","Type":"ContainerStarted","Data":"78411957d67a18a4e64769a2a1ed7fd0da32a8b5171cd79d49e43b0ef5ac6dd4"} Sep 18 13:19:46.905633 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.905613 2580 generic.go:356] "Generic (PLEG): container finished" podID="1090a9ee-3fad-4085-b97f-bae07eef0fc3" containerID="07a31d7d349b2e86becc7fe5253247342967f9e0fd9ec8ff430dd4813fd39df9" exitCode=0 Sep 18 13:19:46.905730 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:46.905644 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" event={"ID":"1090a9ee-3fad-4085-b97f-bae07eef0fc3","Type":"ContainerDied","Data":"07a31d7d349b2e86becc7fe5253247342967f9e0fd9ec8ff430dd4813fd39df9"} Sep 18 13:19:47.620409 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.620377 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:19:47.621276 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.620378 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:19:47.621276 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.620806 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:19:47.624901 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.624876 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 13:19:47.625045 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.624966 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v7xk5\"" Sep 18 13:19:47.625045 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.625019 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 13:19:47.625422 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.625381 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 13:19:47.625422 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.625409 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zvkg5\"" Sep 18 13:19:47.625674 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.625430 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 13:19:47.688907 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.688878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:47.689081 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:47.689057 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:19:47.689081 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:47.689081 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b848d8c94-2k2x9: secret "image-registry-tls" not found Sep 18 13:19:47.689268 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.689117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:47.689268 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:47.689144 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls podName:2efc3662-9438-4c9a-8d83-258d5fe21c8f nodeName:}" failed. No retries permitted until 2026-09-18 13:19:49.689123478 +0000 UTC m=+39.198761835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls") pod "image-registry-7b848d8c94-2k2x9" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f") : secret "image-registry-tls" not found Sep 18 13:19:47.689268 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:47.689240 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:19:47.689446 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:47.689314 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls podName:211a7909-2eed-45a3-b415-7fdb59b6de1e nodeName:}" failed. No retries permitted until 2026-09-18 13:19:49.68929984 +0000 UTC m=+39.198938190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls") pod "dns-default-q5s2h" (UID: "211a7909-2eed-45a3-b415-7fdb59b6de1e") : secret "dns-default-metrics-tls" not found Sep 18 13:19:47.911109 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.911041 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" event={"ID":"1090a9ee-3fad-4085-b97f-bae07eef0fc3","Type":"ContainerStarted","Data":"a61121e2e3f4f80d33496bf859fc6c0b888d80ad81d92d18a58b5f3377a3e222"} Sep 18 13:19:47.936729 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:47.936673 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4zxnd" podStartSLOduration=7.2676468530000005 podStartE2EDuration="35.93666s" totalImagesPullingTime="28.669013147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:47.935176274 +0000 UTC m=+37.444814640" watchObservedRunningTime="2026-09-18 13:19:47.93666 +0000 UTC m=+37.446298366" Sep 18 13:19:48.075244 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:48.075210 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:48.151198 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:48.151167 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:49.705924 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:49.705743 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:49.706421 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:49.705964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:49.706421 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:49.705880 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:19:49.706421 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:49.706000 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b848d8c94-2k2x9: secret "image-registry-tls" not found Sep 18 13:19:49.706421 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:49.706048 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls podName:2efc3662-9438-4c9a-8d83-258d5fe21c8f nodeName:}" failed. No retries permitted until 2026-09-18 13:19:53.706034721 +0000 UTC m=+43.215673082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls") pod "image-registry-7b848d8c94-2k2x9" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f") : secret "image-registry-tls" not found Sep 18 13:19:49.706421 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:49.706132 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:19:49.706421 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:49.706187 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls podName:211a7909-2eed-45a3-b415-7fdb59b6de1e nodeName:}" failed. No retries permitted until 2026-09-18 13:19:53.706173742 +0000 UTC m=+43.215812086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls") pod "dns-default-q5s2h" (UID: "211a7909-2eed-45a3-b415-7fdb59b6de1e") : secret "dns-default-metrics-tls" not found Sep 18 13:19:49.919091 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:49.919059 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tvqnd" event={"ID":"dbab27f6-d66f-44e0-9a48-556495083572","Type":"ContainerStarted","Data":"3f0f8f235d7c8f14790b3417e90a88b2f4e0338887d62e8c1fc9ba5b7d7481f8"} Sep 18 13:19:49.936503 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:49.936461 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tvqnd" podStartSLOduration=2.320166569 podStartE2EDuration="4.936445337s" totalImagesPullingTime="2.616278768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:49.936239826 +0000 UTC m=+39.445878192" watchObservedRunningTime="2026-09-18 13:19:49.936445337 +0000 UTC m=+39.446083681" Sep 18 13:19:50.410442 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:50.410409 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:50.510964 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:50.510933 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:51.081406 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:51.081369 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:51.141259 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:51.141229 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:52.068428 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:52.068397 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:53.733335 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:53.733308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:19:53.733697 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:53.733352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:19:53.733697 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:53.733446 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:19:53.733697 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:53.733454 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:19:53.733697 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:53.733474 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b848d8c94-2k2x9: secret "image-registry-tls" not found Sep 18 13:19:53.733697 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:53.733494 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls podName:211a7909-2eed-45a3-b415-7fdb59b6de1e nodeName:}" failed. No retries permitted until 2026-09-18 13:20:01.733480845 +0000 UTC m=+51.243119202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls") pod "dns-default-q5s2h" (UID: "211a7909-2eed-45a3-b415-7fdb59b6de1e") : secret "dns-default-metrics-tls" not found Sep 18 13:19:53.733697 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:19:53.733513 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls podName:2efc3662-9438-4c9a-8d83-258d5fe21c8f nodeName:}" failed. No retries permitted until 2026-09-18 13:20:01.733501202 +0000 UTC m=+51.243139545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls") pod "image-registry-7b848d8c94-2k2x9" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f") : secret "image-registry-tls" not found Sep 18 13:19:56.958245 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:56.958204 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:57.080556 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:57.080519 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:57.157899 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:57.157862 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:57.967112 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:57.967079 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:58.086998 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:58.086967 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:58.156511 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:58.156442 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:59.877336 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:19:59.877304 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:01.750454 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:01.750417 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:01.790438 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:01.790405 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:20:01.790533 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:01.790494 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:20:01.790581 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:01.790568 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:20:01.790620 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:01.790611 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:20:01.790660 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:01.790622 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b848d8c94-2k2x9: secret "image-registry-tls" not found Sep 18 13:20:01.790660 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:01.790636 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls podName:211a7909-2eed-45a3-b415-7fdb59b6de1e nodeName:}" failed. No retries permitted until 2026-09-18 13:20:17.790615772 +0000 UTC m=+67.300254127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls") pod "dns-default-q5s2h" (UID: "211a7909-2eed-45a3-b415-7fdb59b6de1e") : secret "dns-default-metrics-tls" not found Sep 18 13:20:01.790660 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:01.790658 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls podName:2efc3662-9438-4c9a-8d83-258d5fe21c8f nodeName:}" failed. No retries permitted until 2026-09-18 13:20:17.790648301 +0000 UTC m=+67.300286659 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls") pod "image-registry-7b848d8c94-2k2x9" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f") : secret "image-registry-tls" not found Sep 18 13:20:01.847809 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:01.847768 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:02.869738 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:02.869693 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:10.501340 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:10.501303 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:10.571989 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:10.571961 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:10.895435 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:10.895412 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsq6h" Sep 18 13:20:11.012849 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:11.012814 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:11.112195 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:11.112161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:11.227686 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:11.227601 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:11.330322 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:11.330286 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:14.409871 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.409834 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n"] Sep 18 13:20:14.413326 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.413311 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:14.416967 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.416945 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 18 13:20:14.417085 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.416993 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jj48p\"" Sep 18 13:20:14.417247 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.417232 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:20:14.417506 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.417489 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 18 13:20:14.433427 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.433395 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n"] Sep 18 13:20:14.481028 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.481003 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmgsh\" (UniqueName: \"kubernetes.io/projected/d7e5826f-5d50-4506-b584-4041ac4a35dc-kube-api-access-lmgsh\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:14.481126 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.481063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:14.582267 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.582240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:14.582381 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.582294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmgsh\" (UniqueName: \"kubernetes.io/projected/d7e5826f-5d50-4506-b584-4041ac4a35dc-kube-api-access-lmgsh\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:14.582420 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:14.582378 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 13:20:14.582454 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:14.582436 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls podName:d7e5826f-5d50-4506-b584-4041ac4a35dc nodeName:}" failed. No retries permitted until 2026-09-18 13:20:15.082421348 +0000 UTC m=+64.592059716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-2wz4n" (UID: "d7e5826f-5d50-4506-b584-4041ac4a35dc") : secret "samples-operator-tls" not found Sep 18 13:20:14.616923 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.616901 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmgsh\" (UniqueName: \"kubernetes.io/projected/d7e5826f-5d50-4506-b584-4041ac4a35dc-kube-api-access-lmgsh\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:14.671079 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.671020 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-lqdbs"] Sep 18 13:20:14.672740 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.672712 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.679335 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.679179 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:20:14.679335 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.679250 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 18 13:20:14.679335 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.679311 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 18 13:20:14.680010 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.679995 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 18 13:20:14.680299 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.680282 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-trxd9\"" Sep 18 13:20:14.682900 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.682881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-trusted-ca\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.683033 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.683016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-serving-cert\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.683122 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.683096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-config\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.683175 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.683147 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tl9c\" (UniqueName: \"kubernetes.io/projected/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-kube-api-access-8tl9c\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.684752 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.684737 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 18 13:20:14.688049 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.688032 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-lqdbs"] Sep 18 13:20:14.724833 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.724810 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9"] Sep 18 13:20:14.726570 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.726556 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:14.729486 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.729467 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 18 13:20:14.729580 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.729541 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hpzg9\"" Sep 18 13:20:14.729756 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.729742 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 13:20:14.729833 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.729802 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 13:20:14.729915 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.729900 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 18 13:20:14.741907 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.741888 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9"] Sep 18 13:20:14.744810 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.744766 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:14.783482 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.783463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:14.783573 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.783498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-trusted-ca\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.783573 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.783517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:14.783647 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.783601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-serving-cert\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.783680 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.783654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-config\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.783711 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.783695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tl9c\" (UniqueName: \"kubernetes.io/projected/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-kube-api-access-8tl9c\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.783776 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.783759 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b95gr\" (UniqueName: \"kubernetes.io/projected/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-kube-api-access-b95gr\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:14.784343 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.784324 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-config\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.784676 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.784656 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-trusted-ca\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.785942 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.785924 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-serving-cert\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.797237 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.797219 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tl9c\" (UniqueName: \"kubernetes.io/projected/adbcbf9d-62a6-415c-ab54-6066c4bcc6c3-kube-api-access-8tl9c\") pod \"console-operator-fd4bb46c-lqdbs\" (UID: \"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3\") " pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:14.848884 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.848860 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:14.884946 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.884922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:14.885017 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.885008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b95gr\" (UniqueName: \"kubernetes.io/projected/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-kube-api-access-b95gr\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:14.885055 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.885033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:14.885055 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:14.885050 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:14.885137 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:14.885125 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls podName:bffe10e1-e15b-4f40-9e6d-f49e2b3a908c nodeName:}" failed. No retries permitted until 2026-09-18 13:20:15.385107554 +0000 UTC m=+64.894745911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-4x8h9" (UID: "bffe10e1-e15b-4f40-9e6d-f49e2b3a908c") : secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:14.885563 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.885546 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:14.893904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.893886 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b95gr\" (UniqueName: \"kubernetes.io/projected/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-kube-api-access-b95gr\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:14.948769 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.948697 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:14.981284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:14.981264 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:15.086495 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:15.086457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:15.086677 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:15.086588 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 13:20:15.086677 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:15.086668 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls podName:d7e5826f-5d50-4506-b584-4041ac4a35dc nodeName:}" failed. No retries permitted until 2026-09-18 13:20:16.086649632 +0000 UTC m=+65.596287992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-2wz4n" (UID: "d7e5826f-5d50-4506-b584-4041ac4a35dc") : secret "samples-operator-tls" not found Sep 18 13:20:15.247277 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:15.247201 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-lqdbs"] Sep 18 13:20:15.250310 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:15.250285 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadbcbf9d_62a6_415c_ab54_6066c4bcc6c3.slice/crio-e2cc04b0b686d06cf7f38ff52d6da1b39cd432cbd4712ca22918c87fde178322 WatchSource:0}: Error finding container e2cc04b0b686d06cf7f38ff52d6da1b39cd432cbd4712ca22918c87fde178322: Status 404 returned error can't find the container with id e2cc04b0b686d06cf7f38ff52d6da1b39cd432cbd4712ca22918c87fde178322 Sep 18 13:20:15.388577 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:15.388544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:15.388770 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:15.388710 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:15.388817 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:15.388802 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls podName:bffe10e1-e15b-4f40-9e6d-f49e2b3a908c nodeName:}" failed. No retries permitted until 2026-09-18 13:20:16.38878674 +0000 UTC m=+65.898425083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-4x8h9" (UID: "bffe10e1-e15b-4f40-9e6d-f49e2b3a908c") : secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:15.977827 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:15.977794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" event={"ID":"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3","Type":"ContainerStarted","Data":"e2cc04b0b686d06cf7f38ff52d6da1b39cd432cbd4712ca22918c87fde178322"} Sep 18 13:20:16.093828 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:16.093789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:16.094008 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:16.093938 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 13:20:16.094068 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:16.094009 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls podName:d7e5826f-5d50-4506-b584-4041ac4a35dc nodeName:}" failed. No retries permitted until 2026-09-18 13:20:18.093989083 +0000 UTC m=+67.603627427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-2wz4n" (UID: "d7e5826f-5d50-4506-b584-4041ac4a35dc") : secret "samples-operator-tls" not found Sep 18 13:20:16.395925 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:16.395895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:16.396089 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:16.396003 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:16.396089 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:16.396056 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls podName:bffe10e1-e15b-4f40-9e6d-f49e2b3a908c nodeName:}" failed. No retries permitted until 2026-09-18 13:20:18.39604346 +0000 UTC m=+67.905681804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-4x8h9" (UID: "bffe10e1-e15b-4f40-9e6d-f49e2b3a908c") : secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:17.403961 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.403928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8br\" (UniqueName: \"kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br\") pod \"network-check-target-f9l47\" (UID: \"d7ecc191-ecaa-4911-9fbd-3150a630dba6\") " pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:20:17.404371 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.403973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:20:17.404371 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.404004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:20:17.407030 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.407011 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 13:20:17.407305 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.407286 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 13:20:17.407398 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.407381 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 13:20:17.414626 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:17.414607 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 13:20:17.414692 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:17.414667 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs podName:7e79de33-0f2f-4207-9ea9-276b1f3744f2 nodeName:}" failed. No retries permitted until 2026-09-18 13:21:21.414650827 +0000 UTC m=+130.924289171 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs") pod "network-metrics-daemon-mkf52" (UID: "7e79de33-0f2f-4207-9ea9-276b1f3744f2") : secret "metrics-daemon-secret" not found Sep 18 13:20:17.416771 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.416755 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0361a153-89d1-45d7-a84f-a3fcd4368a2c-original-pull-secret\") pod \"global-pull-secret-syncer-zjkgw\" (UID: \"0361a153-89d1-45d7-a84f-a3fcd4368a2c\") " pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:20:17.417955 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.417938 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 13:20:17.427157 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.427136 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k8br\" (UniqueName: \"kubernetes.io/projected/d7ecc191-ecaa-4911-9fbd-3150a630dba6-kube-api-access-4k8br\") pod \"network-check-target-f9l47\" (UID: \"d7ecc191-ecaa-4911-9fbd-3150a630dba6\") " pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:20:17.632256 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.632223 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjkgw" Sep 18 13:20:17.644072 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.644050 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v7xk5\"" Sep 18 13:20:17.650441 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.650421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:20:17.803821 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.803785 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:17.806673 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.806650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:20:17.806780 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.806763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:20:17.806826 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:17.806813 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 13:20:17.806888 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:17.806876 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 13:20:17.806888 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:17.806884 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls podName:211a7909-2eed-45a3-b415-7fdb59b6de1e nodeName:}" failed. No retries permitted until 2026-09-18 13:20:49.806866841 +0000 UTC m=+99.316505198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls") pod "dns-default-q5s2h" (UID: "211a7909-2eed-45a3-b415-7fdb59b6de1e") : secret "dns-default-metrics-tls" not found Sep 18 13:20:17.806961 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:17.806891 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b848d8c94-2k2x9: secret "image-registry-tls" not found Sep 18 13:20:17.806961 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:17.806923 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls podName:2efc3662-9438-4c9a-8d83-258d5fe21c8f nodeName:}" failed. No retries permitted until 2026-09-18 13:20:49.8069139 +0000 UTC m=+99.316552258 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls") pod "image-registry-7b848d8c94-2k2x9" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f") : secret "image-registry-tls" not found Sep 18 13:20:17.895795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.895698 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:17.905359 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.905336 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zjkgw"] Sep 18 13:20:17.907383 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:17.907355 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0361a153_89d1_45d7_a84f_a3fcd4368a2c.slice/crio-63b2e6853b16eec49c372ee3a7c594a5efce8000440d48d2e91777033b00ef4e WatchSource:0}: Error finding container 63b2e6853b16eec49c372ee3a7c594a5efce8000440d48d2e91777033b00ef4e: Status 404 returned error can't find the container with id 63b2e6853b16eec49c372ee3a7c594a5efce8000440d48d2e91777033b00ef4e Sep 18 13:20:17.924473 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.924449 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f9l47"] Sep 18 13:20:17.927095 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:17.927072 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ecc191_ecaa_4911_9fbd_3150a630dba6.slice/crio-598c7c9790dda5983dc5b6b75b209b1ab9d0bf1328df8951c70ad9cc4de5fc83 WatchSource:0}: Error finding container 598c7c9790dda5983dc5b6b75b209b1ab9d0bf1328df8951c70ad9cc4de5fc83: Status 404 returned error can't find the container with id 598c7c9790dda5983dc5b6b75b209b1ab9d0bf1328df8951c70ad9cc4de5fc83 Sep 18 13:20:17.983087 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.983058 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/0.log" Sep 18 13:20:17.983248 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.983099 2580 generic.go:356] "Generic (PLEG): container finished" podID="adbcbf9d-62a6-415c-ab54-6066c4bcc6c3" containerID="7b347c55ce005831bf06374368570ea2f031165efd992eafab4cf6e3cd79d14c" exitCode=255 Sep 18 13:20:17.983248 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.983134 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" event={"ID":"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3","Type":"ContainerDied","Data":"7b347c55ce005831bf06374368570ea2f031165efd992eafab4cf6e3cd79d14c"} Sep 18 13:20:17.983412 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.983397 2580 scope.go:117] "RemoveContainer" containerID="7b347c55ce005831bf06374368570ea2f031165efd992eafab4cf6e3cd79d14c" Sep 18 13:20:17.984457 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.984432 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f9l47" event={"ID":"d7ecc191-ecaa-4911-9fbd-3150a630dba6","Type":"ContainerStarted","Data":"598c7c9790dda5983dc5b6b75b209b1ab9d0bf1328df8951c70ad9cc4de5fc83"} Sep 18 13:20:17.985567 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:17.985543 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zjkgw" event={"ID":"0361a153-89d1-45d7-a84f-a3fcd4368a2c","Type":"ContainerStarted","Data":"63b2e6853b16eec49c372ee3a7c594a5efce8000440d48d2e91777033b00ef4e"} Sep 18 13:20:18.109921 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.109891 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:18.110062 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.109996 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 13:20:18.110062 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.110049 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls podName:d7e5826f-5d50-4506-b584-4041ac4a35dc nodeName:}" failed. No retries permitted until 2026-09-18 13:20:22.110035059 +0000 UTC m=+71.619673403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-2wz4n" (UID: "d7e5826f-5d50-4506-b584-4041ac4a35dc") : secret "samples-operator-tls" not found Sep 18 13:20:18.258737 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.258652 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5s72c"] Sep 18 13:20:18.260851 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.260831 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.264027 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.264000 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 13:20:18.264139 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.264003 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 13:20:18.264139 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.264003 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 13:20:18.264139 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.264099 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 13:20:18.264345 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.264332 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lqcfs\"" Sep 18 13:20:18.273307 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.273285 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:18.277049 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.277030 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5s72c"] Sep 18 13:20:18.311560 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.311527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4fe7de31-923d-4db0-8d99-83907bac08c0-crio-socket\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.311710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.311571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fe7de31-923d-4db0-8d99-83907bac08c0-data-volume\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.311710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.311608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.311710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.311624 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnc55\" (UniqueName: \"kubernetes.io/projected/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-api-access-wnc55\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.311710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.311708 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.410133 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.410105 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:18.412074 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.412051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:18.412185 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.412082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4fe7de31-923d-4db0-8d99-83907bac08c0-crio-socket\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.412185 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.412111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fe7de31-923d-4db0-8d99-83907bac08c0-data-volume\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.412185 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.412149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.412185 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.412172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnc55\" (UniqueName: \"kubernetes.io/projected/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-api-access-wnc55\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.412383 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.412197 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4fe7de31-923d-4db0-8d99-83907bac08c0-crio-socket\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.412383 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.412215 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:18.412383 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.412279 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls podName:bffe10e1-e15b-4f40-9e6d-f49e2b3a908c nodeName:}" failed. No retries permitted until 2026-09-18 13:20:22.412259772 +0000 UTC m=+71.921898137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-4x8h9" (UID: "bffe10e1-e15b-4f40-9e6d-f49e2b3a908c") : secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:18.412520 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.412447 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:20:18.412520 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.412485 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fe7de31-923d-4db0-8d99-83907bac08c0-data-volume\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.412520 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.412504 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:18.912479114 +0000 UTC m=+68.422117472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : secret "insights-runtime-extractor-tls" not found Sep 18 13:20:18.412657 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.412545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.412695 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.412665 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:20:18.412760 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.412742 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:18.912710082 +0000 UTC m=+68.422348428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : configmap "kube-rbac-proxy" not found Sep 18 13:20:18.422261 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.422214 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnc55\" (UniqueName: \"kubernetes.io/projected/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-api-access-wnc55\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.916882 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.916712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.916882 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.916789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:18.916882 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.916846 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:20:18.916882 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.916869 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:20:18.917209 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.916925 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:19.916904432 +0000 UTC m=+69.426542795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : secret "insights-runtime-extractor-tls" not found Sep 18 13:20:18.917209 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.916943 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:19.916934766 +0000 UTC m=+69.426573111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : configmap "kube-rbac-proxy" not found Sep 18 13:20:18.991281 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.991247 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/1.log" Sep 18 13:20:18.991873 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.991843 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/0.log" Sep 18 13:20:18.992010 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.991888 2580 generic.go:356] "Generic (PLEG): container finished" podID="adbcbf9d-62a6-415c-ab54-6066c4bcc6c3" containerID="3c87bab97e3b693edf17cedff3e3bc5780c4ac35ec0566c759d3b3963951085d" exitCode=255 Sep 18 13:20:18.992010 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.991937 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" event={"ID":"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3","Type":"ContainerDied","Data":"3c87bab97e3b693edf17cedff3e3bc5780c4ac35ec0566c759d3b3963951085d"} Sep 18 13:20:18.992010 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.992003 2580 scope.go:117] "RemoveContainer" containerID="7b347c55ce005831bf06374368570ea2f031165efd992eafab4cf6e3cd79d14c" Sep 18 13:20:18.992828 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:18.992397 2580 scope.go:117] "RemoveContainer" containerID="3c87bab97e3b693edf17cedff3e3bc5780c4ac35ec0566c759d3b3963951085d" Sep 18 13:20:18.992828 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:18.992595 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-lqdbs_openshift-console-operator(adbcbf9d-62a6-415c-ab54-6066c4bcc6c3)\"" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" podUID="adbcbf9d-62a6-415c-ab54-6066c4bcc6c3" Sep 18 13:20:19.926651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:19.926606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:19.927122 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:19.926778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:19.927122 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:19.926787 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:20:19.927122 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:19.926929 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:21.926907634 +0000 UTC m=+71.436545997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : secret "insights-runtime-extractor-tls" not found Sep 18 13:20:19.927122 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:19.926824 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:20:19.927122 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:19.927012 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:21.926997771 +0000 UTC m=+71.436636133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : configmap "kube-rbac-proxy" not found Sep 18 13:20:19.996931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:19.996897 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/1.log" Sep 18 13:20:19.997300 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:19.997277 2580 scope.go:117] "RemoveContainer" containerID="3c87bab97e3b693edf17cedff3e3bc5780c4ac35ec0566c759d3b3963951085d" Sep 18 13:20:19.997530 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:19.997500 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-lqdbs_openshift-console-operator(adbcbf9d-62a6-415c-ab54-6066c4bcc6c3)\"" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" podUID="adbcbf9d-62a6-415c-ab54-6066c4bcc6c3" Sep 18 13:20:20.181230 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:20.181152 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c9xcg_380ff550-0e7a-46ea-a947-9fff416d9181/dns-node-resolver/0.log" Sep 18 13:20:21.187781 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:21.187738 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:21.188614 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:21.188591 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tz7qx_322730aa-4fe2-413f-9df6-8249b41758ee/node-ca/0.log" Sep 18 13:20:21.280225 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:21.280191 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:21.944808 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:21.944774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:21.944994 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:21.944825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:21.944994 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:21.944950 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:20:21.945113 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:21.945017 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:25.944998535 +0000 UTC m=+75.454636898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : configmap "kube-rbac-proxy" not found Sep 18 13:20:21.945113 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:21.944950 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:20:21.945215 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:21.945111 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:25.945089632 +0000 UTC m=+75.454727999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : secret "insights-runtime-extractor-tls" not found Sep 18 13:20:22.146559 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:22.146520 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:22.146775 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:22.146702 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 13:20:22.146866 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:22.146796 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls podName:d7e5826f-5d50-4506-b584-4041ac4a35dc nodeName:}" failed. No retries permitted until 2026-09-18 13:20:30.146773879 +0000 UTC m=+79.656412241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-2wz4n" (UID: "d7e5826f-5d50-4506-b584-4041ac4a35dc") : secret "samples-operator-tls" not found Sep 18 13:20:22.185298 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:22.185250 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tvqnd_dbab27f6-d66f-44e0-9a48-556495083572/serve-healthcheck-canary/0.log" Sep 18 13:20:22.209263 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:22.209180 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:22.268550 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:22.268508 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:22.449917 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:22.449893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:22.450053 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:22.450034 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:22.450117 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:22.450106 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls podName:bffe10e1-e15b-4f40-9e6d-f49e2b3a908c nodeName:}" failed. No retries permitted until 2026-09-18 13:20:30.450082206 +0000 UTC m=+79.959720566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-4x8h9" (UID: "bffe10e1-e15b-4f40-9e6d-f49e2b3a908c") : secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:23.006886 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:23.006841 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f9l47" event={"ID":"d7ecc191-ecaa-4911-9fbd-3150a630dba6","Type":"ContainerStarted","Data":"c9b260a3acb0093754b458fbb649c56c7037a61f675dd0a5a7c8034bfab27eb1"} Sep 18 13:20:23.007071 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:23.006956 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:20:23.008311 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:23.008289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zjkgw" event={"ID":"0361a153-89d1-45d7-a84f-a3fcd4368a2c","Type":"ContainerStarted","Data":"e8537ee52d8730d88c3c1576b44a14f196172c1be8276d9b2f95b46de8f23217"} Sep 18 13:20:23.028368 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:23.028322 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f9l47" podStartSLOduration=66.590674662 podStartE2EDuration="1m11.028308232s" totalImagesPullingTime="4.43763357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:23.024355042 +0000 UTC m=+72.533993409" watchObservedRunningTime="2026-09-18 13:20:23.028308232 +0000 UTC m=+72.537946598" Sep 18 13:20:23.735430 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:23.735394 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:23.819931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:23.819885 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:23.894648 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:23.894527 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:24.016001 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:24.015927 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:24.120032 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:24.120003 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:24.433555 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:24.433519 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:24.534660 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:24.534631 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:24.723061 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:24.722969 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:24.831769 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:24.831740 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:24.982358 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:24.982280 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:24.982358 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:24.982336 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:24.982666 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:24.982654 2580 scope.go:117] "RemoveContainer" containerID="3c87bab97e3b693edf17cedff3e3bc5780c4ac35ec0566c759d3b3963951085d" Sep 18 13:20:24.982832 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:24.982814 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-lqdbs_openshift-console-operator(adbcbf9d-62a6-415c-ab54-6066c4bcc6c3)\"" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" podUID="adbcbf9d-62a6-415c-ab54-6066c4bcc6c3" Sep 18 13:20:25.771158 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:25.771127 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:25.872699 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:25.872666 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:25.979883 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:25.979847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:25.980069 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:25.979898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:25.980069 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:25.980018 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:20:25.980069 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:25.980029 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 13:20:25.980199 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:25.980086 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:33.980068934 +0000 UTC m=+83.489707282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : secret "insights-runtime-extractor-tls" not found Sep 18 13:20:25.980199 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:25.980101 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:33.980095137 +0000 UTC m=+83.489733480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : configmap "kube-rbac-proxy" not found Sep 18 13:20:26.377078 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:26.377046 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:26.480425 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:26.480389 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:27.372479 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:27.372446 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:28.262332 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:28.262303 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:28.515400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:28.515307 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:28.609663 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:28.609633 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:28.686981 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:28.686945 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:28.909151 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:28.909111 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:29.196014 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:29.195929 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:29.369095 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:29.369063 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:30.212904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:30.212868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:30.215215 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:30.215195 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7e5826f-5d50-4506-b584-4041ac4a35dc-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-2wz4n\" (UID: \"d7e5826f-5d50-4506-b584-4041ac4a35dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:30.219628 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:30.219601 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:30.321835 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:30.321801 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" Sep 18 13:20:30.419471 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:30.419438 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:30.514757 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:30.514652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:30.514910 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:30.514782 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:30.514910 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:30.514836 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls podName:bffe10e1-e15b-4f40-9e6d-f49e2b3a908c nodeName:}" failed. No retries permitted until 2026-09-18 13:20:46.514821376 +0000 UTC m=+96.024459719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-4x8h9" (UID: "bffe10e1-e15b-4f40-9e6d-f49e2b3a908c") : secret "cluster-monitoring-operator-tls" not found Sep 18 13:20:30.587338 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:30.587287 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zjkgw" podStartSLOduration=73.125616114 podStartE2EDuration="1m17.587268468s" totalImagesPullingTime="4.461652354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:23.041075028 +0000 UTC m=+72.550713394" watchObservedRunningTime="2026-09-18 13:20:30.587268468 +0000 UTC m=+80.096906868" Sep 18 13:20:30.587573 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:30.587559 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n"] Sep 18 13:20:30.756497 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:30.756460 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:30.950322 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:30.950293 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:31.030045 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:31.030013 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" event={"ID":"d7e5826f-5d50-4506-b584-4041ac4a35dc","Type":"ContainerStarted","Data":"44ef9f0dd79383b8b43bbccf71d06fb5be15d498f560de3c0f2f3423b069674a"} Sep 18 13:20:31.169224 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:31.169192 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:31.355484 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:31.355447 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:31.421454 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:31.421414 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:31.949173 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:31.949119 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:32.080540 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:32.080478 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:32.358266 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:32.358226 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:32.761892 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:32.761814 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:32.980853 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:32.980818 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:33.037735 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:33.037636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" event={"ID":"d7e5826f-5d50-4506-b584-4041ac4a35dc","Type":"ContainerStarted","Data":"b1690b51e26e845b3eb3cee1e7cf0d6ff049e54c182d99f4d3d836f335045918"} Sep 18 13:20:33.037876 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:33.037758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" event={"ID":"d7e5826f-5d50-4506-b584-4041ac4a35dc","Type":"ContainerStarted","Data":"f8c4d430e64946dc813e42d0a3715cf19e35d0877421693c594e5be60ebbad3b"} Sep 18 13:20:33.061854 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:33.061804 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-2wz4n" podStartSLOduration=17.374185321 podStartE2EDuration="19.061790818s" totalImagesPullingTime="1.687605497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:33.061629797 +0000 UTC m=+82.571268171" watchObservedRunningTime="2026-09-18 13:20:33.061790818 +0000 UTC m=+82.571429180" Sep 18 13:20:33.070756 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:33.070707 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:33.165134 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:33.165103 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:33.576014 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:33.575980 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:33.935137 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:33.935034 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:34.011086 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:34.011038 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:34.047286 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:34.047252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:34.047442 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:34.047366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:34.047486 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:34.047470 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 13:20:34.047553 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:20:34.047542 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls podName:4fe7de31-923d-4db0-8d99-83907bac08c0 nodeName:}" failed. No retries permitted until 2026-09-18 13:20:50.047524058 +0000 UTC m=+99.557162418 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s72c" (UID: "4fe7de31-923d-4db0-8d99-83907bac08c0") : secret "insights-runtime-extractor-tls" not found Sep 18 13:20:34.047909 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:34.047890 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe7de31-923d-4db0-8d99-83907bac08c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:34.550527 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:34.550488 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:34.762123 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:34.762089 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:34.956831 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:34.956752 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:35.357420 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:35.357381 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:35.556572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:35.556536 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:36.118294 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:36.118246 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:36.222486 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:36.222451 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:36.563472 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:36.563420 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:36.958339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:36.958221 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:37.163990 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:37.163953 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:37.570811 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:37.570771 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:38.162439 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:38.162380 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:38.564218 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:38.564178 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:38.620657 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:38.620631 2580 scope.go:117] "RemoveContainer" containerID="3c87bab97e3b693edf17cedff3e3bc5780c4ac35ec0566c759d3b3963951085d" Sep 18 13:20:38.757493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:38.757446 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:39.054401 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.054312 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:39.058474 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.058445 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/1.log" Sep 18 13:20:39.058676 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.058510 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" event={"ID":"adbcbf9d-62a6-415c-ab54-6066c4bcc6c3","Type":"ContainerStarted","Data":"d61e1748067a8101d376c7c4a8cd73b35896a9c97ae93b879ae0bc3382db1e16"} Sep 18 13:20:39.058845 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.058819 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:39.063914 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.063894 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" Sep 18 13:20:39.123212 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.123161 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-lqdbs" podStartSLOduration=23.132590055 podStartE2EDuration="25.123144542s" totalImagesPullingTime="1.990554487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:39.121408505 +0000 UTC m=+88.631046873" watchObservedRunningTime="2026-09-18 13:20:39.123144542 +0000 UTC m=+88.632782908" Sep 18 13:20:39.200613 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.200581 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:39.298399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.298370 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:39.418863 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.418776 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:39.594456 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.594406 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:39.696229 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.696152 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:39.814334 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:39.814300 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:40.026052 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:40.025969 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:40.126662 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:40.126626 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:41.014370 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:41.014341 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:41.229468 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:41.229429 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:41.505435 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:41.505400 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:41.871517 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:41.871487 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:41.950025 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:41.949987 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:46.551579 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:46.551544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:46.553977 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:46.553959 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bffe10e1-e15b-4f40-9e6d-f49e2b3a908c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-4x8h9\" (UID: \"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:46.834507 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:46.834421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" Sep 18 13:20:47.071713 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.071676 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:47.105958 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.105883 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9"] Sep 18 13:20:47.109376 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:47.109347 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbffe10e1_e15b_4f40_9e6d_f49e2b3a908c.slice/crio-8b5bd2ab5de1837c576123378d99b0db284e3c6c800d8de6187658afe112fad3 WatchSource:0}: Error finding container 8b5bd2ab5de1837c576123378d99b0db284e3c6c800d8de6187658afe112fad3: Status 404 returned error can't find the container with id 8b5bd2ab5de1837c576123378d99b0db284e3c6c800d8de6187658afe112fad3 Sep 18 13:20:47.159771 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.159739 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:47.615444 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.615412 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l"] Sep 18 13:20:47.617812 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.617797 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.627502 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.627484 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 13:20:47.629724 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.629698 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 13:20:47.629773 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.629745 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 13:20:47.630967 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.630952 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 18 13:20:47.649114 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.649081 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l"] Sep 18 13:20:47.764224 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.764193 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e81dce4a-40a5-4afd-86e7-5f1199849c41-tmp\") pod \"klusterlet-addon-workmgr-96c6fb5dd-4bq9l\" (UID: \"e81dce4a-40a5-4afd-86e7-5f1199849c41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.764400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.764251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnn6r\" (UniqueName: \"kubernetes.io/projected/e81dce4a-40a5-4afd-86e7-5f1199849c41-kube-api-access-rnn6r\") pod \"klusterlet-addon-workmgr-96c6fb5dd-4bq9l\" (UID: \"e81dce4a-40a5-4afd-86e7-5f1199849c41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.764400 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.764370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e81dce4a-40a5-4afd-86e7-5f1199849c41-klusterlet-config\") pod \"klusterlet-addon-workmgr-96c6fb5dd-4bq9l\" (UID: \"e81dce4a-40a5-4afd-86e7-5f1199849c41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.864973 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.864938 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e81dce4a-40a5-4afd-86e7-5f1199849c41-tmp\") pod \"klusterlet-addon-workmgr-96c6fb5dd-4bq9l\" (UID: \"e81dce4a-40a5-4afd-86e7-5f1199849c41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.865177 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.865010 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnn6r\" (UniqueName: \"kubernetes.io/projected/e81dce4a-40a5-4afd-86e7-5f1199849c41-kube-api-access-rnn6r\") pod \"klusterlet-addon-workmgr-96c6fb5dd-4bq9l\" (UID: \"e81dce4a-40a5-4afd-86e7-5f1199849c41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.865177 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.865061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e81dce4a-40a5-4afd-86e7-5f1199849c41-klusterlet-config\") pod \"klusterlet-addon-workmgr-96c6fb5dd-4bq9l\" (UID: \"e81dce4a-40a5-4afd-86e7-5f1199849c41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.865405 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.865382 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e81dce4a-40a5-4afd-86e7-5f1199849c41-tmp\") pod \"klusterlet-addon-workmgr-96c6fb5dd-4bq9l\" (UID: \"e81dce4a-40a5-4afd-86e7-5f1199849c41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.867577 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.867532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e81dce4a-40a5-4afd-86e7-5f1199849c41-klusterlet-config\") pod \"klusterlet-addon-workmgr-96c6fb5dd-4bq9l\" (UID: \"e81dce4a-40a5-4afd-86e7-5f1199849c41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.877004 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.876971 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:47.881113 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.881089 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnn6r\" (UniqueName: \"kubernetes.io/projected/e81dce4a-40a5-4afd-86e7-5f1199849c41-kube-api-access-rnn6r\") pod \"klusterlet-addon-workmgr-96c6fb5dd-4bq9l\" (UID: \"e81dce4a-40a5-4afd-86e7-5f1199849c41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.926203 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.926170 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:47.960478 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:47.960437 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:48.082572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:48.082542 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:48.085467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:48.085439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" event={"ID":"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c","Type":"ContainerStarted","Data":"8b5bd2ab5de1837c576123378d99b0db284e3c6c800d8de6187658afe112fad3"} Sep 18 13:20:48.171494 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:48.171406 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:48.197273 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:48.197246 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l"] Sep 18 13:20:48.199980 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:48.199953 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81dce4a_40a5_4afd_86e7_5f1199849c41.slice/crio-c0a1f0044497914abb925337335929ef5d7a64075afb1182e21464d4b174c80f WatchSource:0}: Error finding container c0a1f0044497914abb925337335929ef5d7a64075afb1182e21464d4b174c80f: Status 404 returned error can't find the container with id c0a1f0044497914abb925337335929ef5d7a64075afb1182e21464d4b174c80f Sep 18 13:20:49.092415 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:49.092375 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" event={"ID":"e81dce4a-40a5-4afd-86e7-5f1199849c41","Type":"ContainerStarted","Data":"c0a1f0044497914abb925337335929ef5d7a64075afb1182e21464d4b174c80f"} Sep 18 13:20:49.883238 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:49.883200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:20:49.883486 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:49.883275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:20:49.885968 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:49.885910 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/211a7909-2eed-45a3-b415-7fdb59b6de1e-metrics-tls\") pod \"dns-default-q5s2h\" (UID: \"211a7909-2eed-45a3-b415-7fdb59b6de1e\") " pod="openshift-dns/dns-default-q5s2h" Sep 18 13:20:49.887025 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:49.887001 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"image-registry-7b848d8c94-2k2x9\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:20:49.894953 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:49.894883 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tljtf\"" Sep 18 13:20:49.902475 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:49.902452 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q5s2h" Sep 18 13:20:50.085185 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:50.085148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:50.088376 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:50.088350 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe7de31-923d-4db0-8d99-83907bac08c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s72c\" (UID: \"4fe7de31-923d-4db0-8d99-83907bac08c0\") " pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:50.162605 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:50.162520 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j6lw2\"" Sep 18 13:20:50.170184 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:50.170160 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:20:50.370330 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:50.370288 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5s72c" Sep 18 13:20:51.097955 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:51.097924 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:51.199289 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:51.199236 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:52.013301 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.013261 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:52.119037 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.118928 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:52.320274 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.320205 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q5s2h"] Sep 18 13:20:52.322214 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:52.322189 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod211a7909_2eed_45a3_b415_7fdb59b6de1e.slice/crio-4810ac1d86a866aa8526ae8d010257b2bf20b739e51fbf6ab1faec5345b11d24 WatchSource:0}: Error finding container 4810ac1d86a866aa8526ae8d010257b2bf20b739e51fbf6ab1faec5345b11d24: Status 404 returned error can't find the container with id 4810ac1d86a866aa8526ae8d010257b2bf20b739e51fbf6ab1faec5345b11d24 Sep 18 13:20:52.331039 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.331013 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5s72c"] Sep 18 13:20:52.333628 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.333607 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b848d8c94-2k2x9"] Sep 18 13:20:52.334761 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:52.334736 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe7de31_923d_4db0_8d99_83907bac08c0.slice/crio-976f8097d44be9f20a9d991acbefdacd3adc53806592c516e210655d47fc287b WatchSource:0}: Error finding container 976f8097d44be9f20a9d991acbefdacd3adc53806592c516e210655d47fc287b: Status 404 returned error can't find the container with id 976f8097d44be9f20a9d991acbefdacd3adc53806592c516e210655d47fc287b Sep 18 13:20:52.336423 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:52.336402 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efc3662_9438_4c9a_8d83_258d5fe21c8f.slice/crio-3504d4619df44029d3225c250b4e9110971259ed4e0208fbde209895a91f79d8 WatchSource:0}: Error finding container 3504d4619df44029d3225c250b4e9110971259ed4e0208fbde209895a91f79d8: Status 404 returned error can't find the container with id 3504d4619df44029d3225c250b4e9110971259ed4e0208fbde209895a91f79d8 Sep 18 13:20:52.474295 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.474262 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:52.575155 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.575076 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:52.655563 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.655530 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:52.659226 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.659200 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx"] Sep 18 13:20:52.662693 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.662676 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx" Sep 18 13:20:52.665997 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.665960 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 13:20:52.666131 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.666055 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qw56h\"" Sep 18 13:20:52.672064 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.672040 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx"] Sep 18 13:20:52.727315 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.727258 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:52.810777 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.810742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1f9cd9e3-fddb-4d42-bd50-6f9cc3bd6e4f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-xq6lx\" (UID: \"1f9cd9e3-fddb-4d42-bd50-6f9cc3bd6e4f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx" Sep 18 13:20:52.912295 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.912208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1f9cd9e3-fddb-4d42-bd50-6f9cc3bd6e4f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-xq6lx\" (UID: \"1f9cd9e3-fddb-4d42-bd50-6f9cc3bd6e4f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx" Sep 18 13:20:52.914474 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.914450 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1f9cd9e3-fddb-4d42-bd50-6f9cc3bd6e4f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-xq6lx\" (UID: \"1f9cd9e3-fddb-4d42-bd50-6f9cc3bd6e4f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx" Sep 18 13:20:52.972678 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:52.972640 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx" Sep 18 13:20:53.109692 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.109666 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5s2h" event={"ID":"211a7909-2eed-45a3-b415-7fdb59b6de1e","Type":"ContainerStarted","Data":"4810ac1d86a866aa8526ae8d010257b2bf20b739e51fbf6ab1faec5345b11d24"} Sep 18 13:20:53.111362 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.111332 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" event={"ID":"e81dce4a-40a5-4afd-86e7-5f1199849c41","Type":"ContainerStarted","Data":"ae06508ac7c434b0a3ac7551d6e60c23f689c15cd1f9cd8f7d072df958e0619b"} Sep 18 13:20:53.111701 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.111681 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:53.113251 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.113227 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" Sep 18 13:20:53.114079 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.114054 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5s72c" event={"ID":"4fe7de31-923d-4db0-8d99-83907bac08c0","Type":"ContainerStarted","Data":"9697f7e332afd46ce4107f316507474f3a0ef4ced39ddb2a2c261de4693c9f8e"} Sep 18 13:20:53.114169 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.114111 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5s72c" event={"ID":"4fe7de31-923d-4db0-8d99-83907bac08c0","Type":"ContainerStarted","Data":"ee4028d16a22dcc9f0b7d75eae7d0ec9d8845df6a5a5ad5cb6e6e32202748cbd"} Sep 18 13:20:53.114169 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.114132 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5s72c" event={"ID":"4fe7de31-923d-4db0-8d99-83907bac08c0","Type":"ContainerStarted","Data":"976f8097d44be9f20a9d991acbefdacd3adc53806592c516e210655d47fc287b"} Sep 18 13:20:53.115874 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.115846 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" event={"ID":"bffe10e1-e15b-4f40-9e6d-f49e2b3a908c","Type":"ContainerStarted","Data":"325285694f3cd82ee9899759e9c230fcd2b5ec7b2dc930ab3fe1d2c3c653171a"} Sep 18 13:20:53.117492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.117462 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" event={"ID":"2efc3662-9438-4c9a-8d83-258d5fe21c8f","Type":"ContainerStarted","Data":"78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7"} Sep 18 13:20:53.117589 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.117505 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" event={"ID":"2efc3662-9438-4c9a-8d83-258d5fe21c8f","Type":"ContainerStarted","Data":"3504d4619df44029d3225c250b4e9110971259ed4e0208fbde209895a91f79d8"} Sep 18 13:20:53.117652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.117603 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:20:53.142001 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.141949 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-96c6fb5dd-4bq9l" podStartSLOduration=2.208468537 podStartE2EDuration="6.141927003s" totalImagesPullingTime="3.933458466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:53.14188969 +0000 UTC m=+102.651528057" watchObservedRunningTime="2026-09-18 13:20:53.141927003 +0000 UTC m=+102.651565370" Sep 18 13:20:53.166971 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.166860 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-4x8h9" podStartSLOduration=34.221701708 podStartE2EDuration="39.16683923s" totalImagesPullingTime="4.945137522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:53.165643158 +0000 UTC m=+102.675281525" watchObservedRunningTime="2026-09-18 13:20:53.16683923 +0000 UTC m=+102.676477597" Sep 18 13:20:53.194942 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.194816 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" podStartSLOduration=100.194796921 podStartE2EDuration="1m40.194796921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:53.194438648 +0000 UTC m=+102.704077029" watchObservedRunningTime="2026-09-18 13:20:53.194796921 +0000 UTC m=+102.704435311" Sep 18 13:20:53.244332 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:53.244301 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx"] Sep 18 13:20:53.248481 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:53.248433 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9cd9e3_fddb_4d42_bd50_6f9cc3bd6e4f.slice/crio-18165dff1041c1eab3904e798f8dae0a820f1da707cb33f7b5bd465c9a373487 WatchSource:0}: Error finding container 18165dff1041c1eab3904e798f8dae0a820f1da707cb33f7b5bd465c9a373487: Status 404 returned error can't find the container with id 18165dff1041c1eab3904e798f8dae0a820f1da707cb33f7b5bd465c9a373487 Sep 18 13:20:54.014431 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.014402 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f9l47" Sep 18 13:20:54.062050 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.061999 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:54.084478 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.084448 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86dd54558d-hfqfv"] Sep 18 13:20:54.087740 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.087694 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.091969 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.091951 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 13:20:54.092748 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.092430 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 13:20:54.092748 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.092501 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 13:20:54.092748 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.092652 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 13:20:54.092945 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.092789 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 13:20:54.093470 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.093012 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 13:20:54.093470 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.093279 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n5dcm\"" Sep 18 13:20:54.093470 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.093362 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 13:20:54.103357 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.103336 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86dd54558d-hfqfv"] Sep 18 13:20:54.124757 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.124702 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx" event={"ID":"1f9cd9e3-fddb-4d42-bd50-6f9cc3bd6e4f","Type":"ContainerStarted","Data":"18165dff1041c1eab3904e798f8dae0a820f1da707cb33f7b5bd465c9a373487"} Sep 18 13:20:54.160212 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.160179 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:54.223367 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.223330 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-oauth-config\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.223551 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.223415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-oauth-serving-cert\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.223551 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.223475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-console-config\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.223551 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.223535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-serving-cert\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.223741 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.223583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-service-ca\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.223741 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.223681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gmrg\" (UniqueName: \"kubernetes.io/projected/2f2f420a-1930-40e1-96fc-1894323ca265-kube-api-access-2gmrg\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.324747 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.324696 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-oauth-config\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.324747 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.324752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-oauth-serving-cert\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.324993 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.324783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-console-config\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.324993 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.324815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-serving-cert\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.324993 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.324842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-service-ca\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.324993 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.324876 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gmrg\" (UniqueName: \"kubernetes.io/projected/2f2f420a-1930-40e1-96fc-1894323ca265-kube-api-access-2gmrg\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.325643 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.325595 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-console-config\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.325643 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.325596 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-oauth-serving-cert\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.325842 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.325666 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-service-ca\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.327486 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.327464 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-serving-cert\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.327486 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.327479 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-oauth-config\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.334249 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.334223 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gmrg\" (UniqueName: \"kubernetes.io/projected/2f2f420a-1930-40e1-96fc-1894323ca265-kube-api-access-2gmrg\") pod \"console-86dd54558d-hfqfv\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.399594 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.399558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:20:54.902236 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:54.902151 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86dd54558d-hfqfv"] Sep 18 13:20:54.988923 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:54.988892 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2f420a_1930_40e1_96fc_1894323ca265.slice/crio-ccd94fb1102efc0eec18aca1123a52636ce0ede9c9d1b91dbf1eae68d623c2c0 WatchSource:0}: Error finding container ccd94fb1102efc0eec18aca1123a52636ce0ede9c9d1b91dbf1eae68d623c2c0: Status 404 returned error can't find the container with id ccd94fb1102efc0eec18aca1123a52636ce0ede9c9d1b91dbf1eae68d623c2c0 Sep 18 13:20:55.134115 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:55.134075 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86dd54558d-hfqfv" event={"ID":"2f2f420a-1930-40e1-96fc-1894323ca265","Type":"ContainerStarted","Data":"ccd94fb1102efc0eec18aca1123a52636ce0ede9c9d1b91dbf1eae68d623c2c0"} Sep 18 13:20:55.136118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:55.136092 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5s72c" event={"ID":"4fe7de31-923d-4db0-8d99-83907bac08c0","Type":"ContainerStarted","Data":"9280a566c4dcc797d80095878b23d359b24be769d3e09cda2dcce26e1e8b9646"} Sep 18 13:20:55.137640 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:55.137619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5s2h" event={"ID":"211a7909-2eed-45a3-b415-7fdb59b6de1e","Type":"ContainerStarted","Data":"215684ba4f0b658b83e1113c4882ef7ba36d9d65f0c4e76fb70bac1a79df9fb2"} Sep 18 13:20:55.137733 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:55.137664 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5s2h" event={"ID":"211a7909-2eed-45a3-b415-7fdb59b6de1e","Type":"ContainerStarted","Data":"9768f1f6292feebc7bbb6c29bdbd8140eb8ad7b03957f28ee700a9a7232d5b62"} Sep 18 13:20:55.158096 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:55.158015 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5s72c" podStartSLOduration=35.001129757 podStartE2EDuration="37.158001786s" totalImagesPullingTime="2.156872029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:20:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:55.156011899 +0000 UTC m=+104.665650263" watchObservedRunningTime="2026-09-18 13:20:55.158001786 +0000 UTC m=+104.667640151" Sep 18 13:20:55.174304 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:55.174252 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q5s2h" podStartSLOduration=67.860742935 podStartE2EDuration="1m10.174236139s" totalImagesPullingTime="2.313493204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:55.172944404 +0000 UTC m=+104.682582761" watchObservedRunningTime="2026-09-18 13:20:55.174236139 +0000 UTC m=+104.683874507" Sep 18 13:20:56.147454 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.146611 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx" event={"ID":"1f9cd9e3-fddb-4d42-bd50-6f9cc3bd6e4f","Type":"ContainerStarted","Data":"f20f1c2fc0cba513fd95ae4d7f738e38fa62ddc068f5a93b5b4782003d248cc6"} Sep 18 13:20:56.147454 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.147376 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx" Sep 18 13:20:56.147454 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.147413 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q5s2h" Sep 18 13:20:56.153448 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.153366 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx" Sep 18 13:20:56.166375 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.166321 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xq6lx" podStartSLOduration=2.061135505 podStartE2EDuration="4.166301812s" totalImagesPullingTime="2.105166307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:56.163338299 +0000 UTC m=+105.672976665" watchObservedRunningTime="2026-09-18 13:20:56.166301812 +0000 UTC m=+105.675940179" Sep 18 13:20:56.262253 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.262224 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-749c7cf8f7-fql8b"] Sep 18 13:20:56.277023 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.276936 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.279227 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.279201 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749c7cf8f7-fql8b"] Sep 18 13:20:56.285698 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.285655 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 13:20:56.286831 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.286784 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:56.341372 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.341337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-config\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.341508 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.341384 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-oauth-serving-cert\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.341508 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.341454 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-service-ca\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.341603 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.341550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-trusted-ca-bundle\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.341603 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.341588 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-oauth-config\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.341687 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.341623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klv6s\" (UniqueName: \"kubernetes.io/projected/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-kube-api-access-klv6s\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.341687 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.341663 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-serving-cert\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.442560 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.442464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-trusted-ca-bundle\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.442560 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.442519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-oauth-config\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.442560 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.442552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klv6s\" (UniqueName: \"kubernetes.io/projected/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-kube-api-access-klv6s\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.442890 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.442583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-serving-cert\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.442890 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.442629 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-config\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.442890 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.442663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-oauth-serving-cert\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.442890 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.442693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-service-ca\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.443466 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.443398 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-service-ca\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.443567 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.443527 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-config\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.443619 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.443596 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-trusted-ca-bundle\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.443679 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.443650 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-oauth-serving-cert\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.445668 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.445638 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-oauth-config\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.446543 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.446521 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-serving-cert\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.452953 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.452907 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klv6s\" (UniqueName: \"kubernetes.io/projected/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-kube-api-access-klv6s\") pod \"console-749c7cf8f7-fql8b\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.589010 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.588973 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:20:56.688088 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.688054 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:56.752760 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.752539 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:56.925366 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:56.925333 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:58.850879 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:58.850835 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:58.950826 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:58.950787 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:20:59.355781 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:20:59.355735 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749c7cf8f7-fql8b"] Sep 18 13:20:59.358280 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:20:59.358250 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4d6428_0db2_46a7_81d0_53b88a9f8df5.slice/crio-8b2474d3137abe5c180f7ecb8ba7fea46c3b385e8d0114f8e692056e297ba2b9 WatchSource:0}: Error finding container 8b2474d3137abe5c180f7ecb8ba7fea46c3b385e8d0114f8e692056e297ba2b9: Status 404 returned error can't find the container with id 8b2474d3137abe5c180f7ecb8ba7fea46c3b385e8d0114f8e692056e297ba2b9 Sep 18 13:21:00.163424 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:00.163394 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86dd54558d-hfqfv" event={"ID":"2f2f420a-1930-40e1-96fc-1894323ca265","Type":"ContainerStarted","Data":"2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f"} Sep 18 13:21:00.165028 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:00.165004 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749c7cf8f7-fql8b" event={"ID":"fa4d6428-0db2-46a7-81d0-53b88a9f8df5","Type":"ContainerStarted","Data":"1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf"} Sep 18 13:21:00.165148 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:00.165045 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749c7cf8f7-fql8b" event={"ID":"fa4d6428-0db2-46a7-81d0-53b88a9f8df5","Type":"ContainerStarted","Data":"8b2474d3137abe5c180f7ecb8ba7fea46c3b385e8d0114f8e692056e297ba2b9"} Sep 18 13:21:00.182960 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:00.182902 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86dd54558d-hfqfv" podStartSLOduration=2.04756817 podStartE2EDuration="6.182888849s" totalImagesPullingTime="4.135320679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:00.182378341 +0000 UTC m=+109.692016704" watchObservedRunningTime="2026-09-18 13:21:00.182888849 +0000 UTC m=+109.692527215" Sep 18 13:21:00.201385 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:00.201337 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-749c7cf8f7-fql8b" podStartSLOduration=4.201321835 podStartE2EDuration="4.201321835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:00.200580168 +0000 UTC m=+109.710218558" watchObservedRunningTime="2026-09-18 13:21:00.201321835 +0000 UTC m=+109.710960201" Sep 18 13:21:02.469543 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:02.469511 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:02.538956 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:02.538917 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:04.068508 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:04.068473 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:04.124607 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:04.124574 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:04.400443 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:04.400355 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:21:04.400443 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:04.400415 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:21:04.405114 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:04.405094 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:21:05.186452 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:05.186422 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:21:05.953286 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:05.953247 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:06.150478 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:06.150446 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q5s2h" Sep 18 13:21:06.589809 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:06.589768 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:21:06.590299 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:06.589864 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:21:06.594406 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:06.594387 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:21:07.192342 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:07.192312 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:21:07.236510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:07.236477 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:07.254639 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:07.254606 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86dd54558d-hfqfv"] Sep 18 13:21:07.336370 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:07.336327 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:07.910474 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:07.910440 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:08.310488 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.310454 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:08.359619 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.359583 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5wwnk"] Sep 18 13:21:08.362875 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.362858 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-d7k5c"] Sep 18 13:21:08.363002 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.362983 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.365251 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.365232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.370653 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.370634 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 13:21:08.370775 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.370651 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 13:21:08.370775 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.370651 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 13:21:08.370775 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.370703 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-98qfc\"" Sep 18 13:21:08.370775 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.370704 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 13:21:08.371193 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.371180 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 13:21:08.371266 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.371219 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 13:21:08.372438 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.372403 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 13:21:08.375981 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.375919 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mklqt\"" Sep 18 13:21:08.410146 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.410118 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-d7k5c"] Sep 18 13:21:08.428323 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428298 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-root\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.428323 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428325 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.428498 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbdv8\" (UniqueName: \"kubernetes.io/projected/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-api-access-zbdv8\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.428498 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428371 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-wtmp\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.428498 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.428596 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428494 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.428596 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428529 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-tls\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.428596 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-sys\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.428596 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2dxv\" (UniqueName: \"kubernetes.io/projected/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-kube-api-access-h2dxv\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.428743 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.428743 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-textfile\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.428743 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.428743 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.428884 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428745 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.428884 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.428775 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-metrics-client-ca\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.530026 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.529995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-textfile\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.530026 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.530295 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.530295 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.530295 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-metrics-client-ca\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.530295 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-root\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.530487 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.530487 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbdv8\" (UniqueName: \"kubernetes.io/projected/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-api-access-zbdv8\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.530487 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530459 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-wtmp\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.530487 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.530710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.530710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-tls\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.530710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-sys\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.530710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530621 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-wtmp\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.530710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530393 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-textfile\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.530710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530392 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.530710 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2dxv\" (UniqueName: \"kubernetes.io/projected/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-kube-api-access-h2dxv\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.531125 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530743 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.531125 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:21:08.530756 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 13:21:08.531125 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530786 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.531125 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530412 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-root\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.531125 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:21:08.530820 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-tls podName:8f5c8d69-6617-4e5a-aa2c-f27c8415619a nodeName:}" failed. No retries permitted until 2026-09-18 13:21:09.030802656 +0000 UTC m=+118.540441018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-tls") pod "node-exporter-5wwnk" (UID: "8f5c8d69-6617-4e5a-aa2c-f27c8415619a") : secret "node-exporter-tls" not found Sep 18 13:21:08.531125 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530864 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-metrics-client-ca\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.531125 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530921 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-sys\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.531125 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.530943 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.531125 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.531071 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.533422 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.533403 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.533543 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.533525 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.533648 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.533619 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.545639 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.545617 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbdv8\" (UniqueName: \"kubernetes.io/projected/a5658efc-42d1-425a-8bc8-c73b7e8e44b4-kube-api-access-zbdv8\") pod \"kube-state-metrics-84c885658c-d7k5c\" (UID: \"a5658efc-42d1-425a-8bc8-c73b7e8e44b4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.549732 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.549702 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2dxv\" (UniqueName: \"kubernetes.io/projected/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-kube-api-access-h2dxv\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:08.555622 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.555601 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:08.678863 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.678766 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" Sep 18 13:21:08.892406 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.892368 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:08.982821 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:08.982767 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-d7k5c"] Sep 18 13:21:08.985294 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:21:08.985269 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5658efc_42d1_425a_8bc8_c73b7e8e44b4.slice/crio-ba31596205ddd676dbc15dedaaab37931e0ecb5afe55a3977befc83b030bab63 WatchSource:0}: Error finding container ba31596205ddd676dbc15dedaaab37931e0ecb5afe55a3977befc83b030bab63: Status 404 returned error can't find the container with id ba31596205ddd676dbc15dedaaab37931e0ecb5afe55a3977befc83b030bab63 Sep 18 13:21:09.034450 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.034416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-tls\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:09.036693 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.036676 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f5c8d69-6617-4e5a-aa2c-f27c8415619a-node-exporter-tls\") pod \"node-exporter-5wwnk\" (UID: \"8f5c8d69-6617-4e5a-aa2c-f27c8415619a\") " pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:09.086049 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.086017 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:09.197051 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.197016 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" event={"ID":"a5658efc-42d1-425a-8bc8-c73b7e8e44b4","Type":"ContainerStarted","Data":"ba31596205ddd676dbc15dedaaab37931e0ecb5afe55a3977befc83b030bab63"} Sep 18 13:21:09.241061 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.240985 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:09.273048 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.273020 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wwnk" Sep 18 13:21:09.282807 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:21:09.282783 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5c8d69_6617_4e5a_aa2c_f27c8415619a.slice/crio-05aa3bbd6dad81062e52a9fe883fbb49a0eafb10c297c22dc4d428b558e204a0 WatchSource:0}: Error finding container 05aa3bbd6dad81062e52a9fe883fbb49a0eafb10c297c22dc4d428b558e204a0: Status 404 returned error can't find the container with id 05aa3bbd6dad81062e52a9fe883fbb49a0eafb10c297c22dc4d428b558e204a0 Sep 18 13:21:09.402613 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.402580 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:09.480728 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.480690 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:21:09.483625 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.483610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.496920 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.496866 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 13:21:09.497429 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.497415 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 13:21:09.497512 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.497494 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 13:21:09.497572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.497532 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 13:21:09.498882 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.498866 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 13:21:09.498957 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.498948 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 13:21:09.499324 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.499311 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 13:21:09.499561 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.499548 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 13:21:09.499616 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.499554 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tlzwd\"" Sep 18 13:21:09.499810 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.499797 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 13:21:09.538393 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538368 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538489 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538489 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538570 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538570 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538648 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538648 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-config-volume\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538648 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538762 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538660 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6sth\" (UniqueName: \"kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-kube-api-access-t6sth\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538762 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538697 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538762 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-config-out\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538861 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.538861 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.538814 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-web-config\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.594485 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.594458 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:21:09.628723 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.628692 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:09.639713 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.639689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.639830 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.639755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.639830 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.639774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.639830 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.639797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-config-volume\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.639830 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.639812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.640041 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:21:09.639838 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-trusted-ca-bundle podName:577cccdd-bb78-4449-befe-4d7c2a11217c nodeName:}" failed. No retries permitted until 2026-09-18 13:21:10.139815053 +0000 UTC m=+119.649453412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c") : configmap references non-existent config key: ca-bundle.crt Sep 18 13:21:09.640041 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.639904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6sth\" (UniqueName: \"kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-kube-api-access-t6sth\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.640041 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.639944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.640041 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.639976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-config-out\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.640041 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.640015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.640293 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.640049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-web-config\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.640293 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.640100 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.640293 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.640123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.640293 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.640151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.640792 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.640741 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.641700 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.641681 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.642949 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.642899 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-config-out\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.643120 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.643085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.643460 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.643437 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.643644 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.643555 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.644093 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.644054 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-web-config\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.644214 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.644192 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.644623 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.644601 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.644709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.644674 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-config-volume\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.644818 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.644803 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.661455 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.661435 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6sth\" (UniqueName: \"kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-kube-api-access-t6sth\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:09.864903 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.864858 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b848d8c94-2k2x9"] Sep 18 13:21:09.871828 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:09.871761 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:21:10.064118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:10.064080 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:10.144892 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:10.144786 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:10.145783 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:10.145751 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:10.195996 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:10.195948 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:10.203465 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:10.203377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wwnk" event={"ID":"8f5c8d69-6617-4e5a-aa2c-f27c8415619a","Type":"ContainerStarted","Data":"05aa3bbd6dad81062e52a9fe883fbb49a0eafb10c297c22dc4d428b558e204a0"} Sep 18 13:21:10.321798 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:10.321760 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:10.392585 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:10.392544 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:21:10.857817 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:21:10.857781 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577cccdd_bb78_4449_befe_4d7c2a11217c.slice/crio-92684c4483e28291ad34247eeccd9726cdc0b8e4c5ccaa620cf4ffbc2fa51492 WatchSource:0}: Error finding container 92684c4483e28291ad34247eeccd9726cdc0b8e4c5ccaa620cf4ffbc2fa51492: Status 404 returned error can't find the container with id 92684c4483e28291ad34247eeccd9726cdc0b8e4c5ccaa620cf4ffbc2fa51492 Sep 18 13:21:10.858163 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:10.858143 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:21:11.210210 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.210175 2580 generic.go:356] "Generic (PLEG): container finished" podID="8f5c8d69-6617-4e5a-aa2c-f27c8415619a" containerID="7f3ae253f0ee4d8c38129d79d73fba8f6ff155f7561ff9ff893868dd3fc62fd8" exitCode=0 Sep 18 13:21:11.210698 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.210266 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wwnk" event={"ID":"8f5c8d69-6617-4e5a-aa2c-f27c8415619a","Type":"ContainerDied","Data":"7f3ae253f0ee4d8c38129d79d73fba8f6ff155f7561ff9ff893868dd3fc62fd8"} Sep 18 13:21:11.213179 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.213151 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" event={"ID":"a5658efc-42d1-425a-8bc8-c73b7e8e44b4","Type":"ContainerStarted","Data":"66f8e77b57c2181553c66bdba1c54cdbd850c9a4fb96ef0c75c1eabfb7f45be2"} Sep 18 13:21:11.213299 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.213215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" event={"ID":"a5658efc-42d1-425a-8bc8-c73b7e8e44b4","Type":"ContainerStarted","Data":"3054445bf8cf52816e42643b0d25c89abc61168bce4556da07326ad2e4b46501"} Sep 18 13:21:11.213299 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.213245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" event={"ID":"a5658efc-42d1-425a-8bc8-c73b7e8e44b4","Type":"ContainerStarted","Data":"87ecdb9f8a25b69f24c19fdbde481b8eeccec832d15ccfcd369e36da2f8231d6"} Sep 18 13:21:11.215413 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.215390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerStarted","Data":"92684c4483e28291ad34247eeccd9726cdc0b8e4c5ccaa620cf4ffbc2fa51492"} Sep 18 13:21:11.277336 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.277292 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-d7k5c" podStartSLOduration=1.695584229 podStartE2EDuration="3.277275644s" totalImagesPullingTime="1.581691415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:11.277164398 +0000 UTC m=+120.786802764" watchObservedRunningTime="2026-09-18 13:21:11.277275644 +0000 UTC m=+120.786914010" Sep 18 13:21:11.278217 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.278183 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:11.381980 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.381944 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:11.727652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.727608 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:11.891197 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:11.891166 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:12.220893 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:12.220795 2580 generic.go:356] "Generic (PLEG): container finished" podID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerID="dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1" exitCode=0 Sep 18 13:21:12.221261 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:12.220890 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerDied","Data":"dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1"} Sep 18 13:21:12.223239 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:12.223208 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wwnk" event={"ID":"8f5c8d69-6617-4e5a-aa2c-f27c8415619a","Type":"ContainerStarted","Data":"2b009be47208169de9f27a948c93d28bef3e2b2c0531c8d59f1de92e2bdd54c6"} Sep 18 13:21:12.223335 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:12.223267 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wwnk" event={"ID":"8f5c8d69-6617-4e5a-aa2c-f27c8415619a","Type":"ContainerStarted","Data":"5d84291414de6cb6f2684e39eb06cd13b67761ddc305571795da18136191bb71"} Sep 18 13:21:12.267098 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:12.267062 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:12.286795 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:12.286744 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5wwnk" podStartSLOduration=2.928638841 podStartE2EDuration="4.286705752s" totalImagesPullingTime="1.281648889s" totalInitContainerRuntime="76.418022ms" isStatefulPod=true podCreationTimestamp="2026-09-18 13:21:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:12.285303638 +0000 UTC m=+121.794942004" watchObservedRunningTime="2026-09-18 13:21:12.286705752 +0000 UTC m=+121.796344119" Sep 18 13:21:12.359777 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:12.359741 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:13.010338 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.010297 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-2t452"] Sep 18 13:21:13.012665 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.012636 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:13.016632 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:21:13.016603 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"monitoring-plugin-cert\" is forbidden: User \"system:node:ip-10-0-129-232.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-232.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" type="*v1.Secret" Sep 18 13:21:13.021193 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:21:13.021046 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"monitoring-plugin-5984459ff8-2t452\" is forbidden: User \"system:node:ip-10-0-129-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-232.ec2.internal' and this object" podUID="2e0624f2-a25c-4d9a-a9cd-afb50e587bec" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:13.021908 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:21:13.021882 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"monitoring-plugin-dockercfg-km8lc\" is forbidden: User \"system:node:ip-10-0-129-232.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-232.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-km8lc\"" type="*v1.Secret" Sep 18 13:21:13.033013 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.032982 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-2t452"] Sep 18 13:21:13.058670 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.058640 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:13.071562 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.071534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr7dh\" (UniqueName: \"kubernetes.io/projected/2e0624f2-a25c-4d9a-a9cd-afb50e587bec-kube-api-access-xr7dh\") pod \"monitoring-plugin-5984459ff8-2t452\" (UID: \"2e0624f2-a25c-4d9a-a9cd-afb50e587bec\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:13.071681 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.071589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e0624f2-a25c-4d9a-a9cd-afb50e587bec-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-2t452\" (UID: \"2e0624f2-a25c-4d9a-a9cd-afb50e587bec\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:13.173104 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.173068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e0624f2-a25c-4d9a-a9cd-afb50e587bec-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-2t452\" (UID: \"2e0624f2-a25c-4d9a-a9cd-afb50e587bec\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:13.173295 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.173189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7dh\" (UniqueName: \"kubernetes.io/projected/2e0624f2-a25c-4d9a-a9cd-afb50e587bec-kube-api-access-xr7dh\") pod \"monitoring-plugin-5984459ff8-2t452\" (UID: \"2e0624f2-a25c-4d9a-a9cd-afb50e587bec\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:13.194487 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.194462 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr7dh\" (UniqueName: \"kubernetes.io/projected/2e0624f2-a25c-4d9a-a9cd-afb50e587bec-kube-api-access-xr7dh\") pod \"monitoring-plugin-5984459ff8-2t452\" (UID: \"2e0624f2-a25c-4d9a-a9cd-afb50e587bec\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:13.228033 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.228006 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:13.418453 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.418412 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:13.661109 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.661086 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86c656b4c8-wkb8r"] Sep 18 13:21:13.667792 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.667765 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.688410 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.688390 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 18 13:21:13.691284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.691262 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 18 13:21:13.691422 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.691337 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zhsh8\"" Sep 18 13:21:13.692365 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.692346 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 18 13:21:13.692450 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.692386 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 18 13:21:13.692932 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.692914 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 18 13:21:13.705669 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.705643 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 18 13:21:13.706565 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.706545 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86c656b4c8-wkb8r"] Sep 18 13:21:13.778798 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.778770 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-telemeter-client-tls\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.778929 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.778821 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.778929 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.778859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfc18c1f-898c-42b2-9667-8affb59cda6d-serving-certs-ca-bundle\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.778929 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.778875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-secret-telemeter-client\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.778929 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.778898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfc18c1f-898c-42b2-9667-8affb59cda6d-metrics-client-ca\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.779093 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.778947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k97pg\" (UniqueName: \"kubernetes.io/projected/dfc18c1f-898c-42b2-9667-8affb59cda6d-kube-api-access-k97pg\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.779093 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.778966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-federate-client-tls\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.779093 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.779067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfc18c1f-898c-42b2-9667-8affb59cda6d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.880143 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.880116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-telemeter-client-tls\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.880247 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.880147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.880247 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.880175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfc18c1f-898c-42b2-9667-8affb59cda6d-serving-certs-ca-bundle\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.880247 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.880192 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-secret-telemeter-client\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.880416 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.880295 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfc18c1f-898c-42b2-9667-8affb59cda6d-metrics-client-ca\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.880416 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.880366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k97pg\" (UniqueName: \"kubernetes.io/projected/dfc18c1f-898c-42b2-9667-8affb59cda6d-kube-api-access-k97pg\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.880416 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.880397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-federate-client-tls\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.880558 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.880481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfc18c1f-898c-42b2-9667-8affb59cda6d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.881015 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.880950 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfc18c1f-898c-42b2-9667-8affb59cda6d-serving-certs-ca-bundle\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.881215 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.881114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfc18c1f-898c-42b2-9667-8affb59cda6d-metrics-client-ca\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.881932 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.881374 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfc18c1f-898c-42b2-9667-8affb59cda6d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.883472 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.883446 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-telemeter-client-tls\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.883561 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.883529 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-secret-telemeter-client\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.883561 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.883532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-federate-client-tls\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.883664 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.883612 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfc18c1f-898c-42b2-9667-8affb59cda6d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.893606 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.893578 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k97pg\" (UniqueName: \"kubernetes.io/projected/dfc18c1f-898c-42b2-9667-8affb59cda6d-kube-api-access-k97pg\") pod \"telemeter-client-86c656b4c8-wkb8r\" (UID: \"dfc18c1f-898c-42b2-9667-8affb59cda6d\") " pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:13.893822 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.893798 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:13.977553 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:13.977472 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" Sep 18 13:21:14.036813 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.036573 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:14.138278 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.138244 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 13:21:14.146402 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.146372 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e0624f2-a25c-4d9a-a9cd-afb50e587bec-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-2t452\" (UID: \"2e0624f2-a25c-4d9a-a9cd-afb50e587bec\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:14.233900 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.233830 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerStarted","Data":"82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734"} Sep 18 13:21:14.234215 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.233902 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerStarted","Data":"473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8"} Sep 18 13:21:14.234215 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.233928 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerStarted","Data":"b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1"} Sep 18 13:21:14.234215 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.233951 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerStarted","Data":"ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308"} Sep 18 13:21:14.234215 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.233976 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerStarted","Data":"fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f"} Sep 18 13:21:14.262336 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.262315 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86c656b4c8-wkb8r"] Sep 18 13:21:14.264191 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:21:14.264165 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc18c1f_898c_42b2_9667_8affb59cda6d.slice/crio-613ed86de9edfd4a6dd7cabeed6c79b22d30c3c4217902a8267dad05c9d21fdd WatchSource:0}: Error finding container 613ed86de9edfd4a6dd7cabeed6c79b22d30c3c4217902a8267dad05c9d21fdd: Status 404 returned error can't find the container with id 613ed86de9edfd4a6dd7cabeed6c79b22d30c3c4217902a8267dad05c9d21fdd Sep 18 13:21:14.274642 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.274619 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-km8lc\"" Sep 18 13:21:14.284621 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.284600 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:14.560380 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.560355 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-2t452"] Sep 18 13:21:14.660958 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:21:14.660927 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0624f2_a25c_4d9a_a9cd_afb50e587bec.slice/crio-d909683f45b37d2d14911f2f24c2396bfc64e1ad4ccc6467dbd710d63a5d9ade WatchSource:0}: Error finding container d909683f45b37d2d14911f2f24c2396bfc64e1ad4ccc6467dbd710d63a5d9ade: Status 404 returned error can't find the container with id d909683f45b37d2d14911f2f24c2396bfc64e1ad4ccc6467dbd710d63a5d9ade Sep 18 13:21:14.668521 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.668497 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:21:14.671190 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.671172 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.679792 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.679608 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 13:21:14.679792 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.679645 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 13:21:14.679792 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.679654 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 13:21:14.679792 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.679670 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 13:21:14.680029 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.680012 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 13:21:14.680096 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.680013 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 13:21:14.680204 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.680100 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-69lxv\"" Sep 18 13:21:14.680204 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.680107 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 13:21:14.680897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.680853 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 13:21:14.680897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.680866 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 13:21:14.680897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.680882 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 13:21:14.681073 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.680915 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 13:21:14.681073 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.680936 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 13:21:14.681073 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.681010 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 13:21:14.681474 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.681450 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-br369i0j1t8sb\"" Sep 18 13:21:14.682148 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.682125 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:14.682582 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.682568 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 13:21:14.691483 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.691466 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 13:21:14.694908 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.694889 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:21:14.788971 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.788938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.788971 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.788974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.788992 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-web-config\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789312 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789165 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789312 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789219 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-config\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789312 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789246 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789312 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kjjb\" (UniqueName: \"kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-kube-api-access-9kjjb\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789312 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789500 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789500 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789382 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789500 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789500 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789687 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789508 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789687 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789542 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789687 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.789687 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.789646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-config-out\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890439 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-config-out\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890439 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890439 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890439 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890656 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-web-config\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-config\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kjjb\" (UniqueName: \"kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-kube-api-access-9kjjb\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.890904 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.891348 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890926 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.891348 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.890957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.891348 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.891001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.891348 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.891032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.891348 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.891070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.891348 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.891094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.891348 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.891135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.891348 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.891342 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.892337 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.892041 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.892337 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.892099 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.892514 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.892392 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.894437 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.893394 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.894437 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.893479 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.894437 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.893843 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.894437 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.894306 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-config-out\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.894437 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.894370 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.894437 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.894386 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.894813 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.894639 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.895118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.895090 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-web-config\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.895825 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.895380 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.895825 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.895651 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.895825 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.895754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.895825 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.895784 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.895825 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.895823 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-config\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.896770 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.896749 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.897059 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.897042 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.902039 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.902022 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kjjb\" (UniqueName: \"kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-kube-api-access-9kjjb\") pod \"prometheus-k8s-0\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:14.980767 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:14.980733 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:15.241805 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:15.241730 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerStarted","Data":"427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc"} Sep 18 13:21:15.243073 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:15.243050 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" event={"ID":"dfc18c1f-898c-42b2-9667-8affb59cda6d","Type":"ContainerStarted","Data":"613ed86de9edfd4a6dd7cabeed6c79b22d30c3c4217902a8267dad05c9d21fdd"} Sep 18 13:21:15.244196 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:15.244174 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" event={"ID":"2e0624f2-a25c-4d9a-a9cd-afb50e587bec","Type":"ContainerStarted","Data":"d909683f45b37d2d14911f2f24c2396bfc64e1ad4ccc6467dbd710d63a5d9ade"} Sep 18 13:21:15.275602 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:15.275572 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:21:15.278333 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:15.278283 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.178041932 podStartE2EDuration="6.278262848s" totalImagesPullingTime="3.084477033s" totalInitContainerRuntime="15.743883ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:15.276220461 +0000 UTC m=+124.785858862" watchObservedRunningTime="2026-09-18 13:21:15.278262848 +0000 UTC m=+124.787901216" Sep 18 13:21:15.280177 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:21:15.280147 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b51218_a43b_4839_a373_347622286dd1.slice/crio-5a066eb0ed53713f8c1765961d9271d0989c1c1b86251d4d10a216735e074b34 WatchSource:0}: Error finding container 5a066eb0ed53713f8c1765961d9271d0989c1c1b86251d4d10a216735e074b34: Status 404 returned error can't find the container with id 5a066eb0ed53713f8c1765961d9271d0989c1c1b86251d4d10a216735e074b34 Sep 18 13:21:15.730164 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:15.730098 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:15.800755 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:15.800707 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:16.217950 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:16.217916 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:16.252884 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:16.252848 2580 generic.go:356] "Generic (PLEG): container finished" podID="89b51218-a43b-4839-a373-347622286dd1" containerID="a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4" exitCode=0 Sep 18 13:21:16.253323 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:16.252930 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerDied","Data":"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4"} Sep 18 13:21:16.253323 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:16.253005 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerStarted","Data":"5a066eb0ed53713f8c1765961d9271d0989c1c1b86251d4d10a216735e074b34"} Sep 18 13:21:16.305810 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:16.305275 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:17.264463 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:17.264424 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" event={"ID":"2e0624f2-a25c-4d9a-a9cd-afb50e587bec","Type":"ContainerStarted","Data":"fafe2a1d1b434e0901bf2d32db0f08cd2e70cfc51a8ca02ba6317ebd5c8233ad"} Sep 18 13:21:17.264975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:17.264520 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:17.267325 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:17.267296 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" event={"ID":"dfc18c1f-898c-42b2-9667-8affb59cda6d","Type":"ContainerStarted","Data":"ac986caf94e5daf312870262a507f33c6507aed14d54dc06cef9b39055aebe98"} Sep 18 13:21:17.267441 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:17.267348 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" event={"ID":"dfc18c1f-898c-42b2-9667-8affb59cda6d","Type":"ContainerStarted","Data":"7af431cd994b4d9e2c6252bc10e94c85b024ff7f6a26754742b6d379f1507f42"} Sep 18 13:21:17.267441 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:17.267376 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" event={"ID":"dfc18c1f-898c-42b2-9667-8affb59cda6d","Type":"ContainerStarted","Data":"3ab95d2f25debeb9567db48e73beb405fcc604067bec6afb31c36568c05bf4db"} Sep 18 13:21:17.271666 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:17.271645 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" Sep 18 13:21:17.283567 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:17.283523 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2t452" podStartSLOduration=3.519493029 podStartE2EDuration="5.283510062s" totalImagesPullingTime="1.764017033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:17.280911081 +0000 UTC m=+126.790549448" watchObservedRunningTime="2026-09-18 13:21:17.283510062 +0000 UTC m=+126.793148419" Sep 18 13:21:17.312260 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:17.312172 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86c656b4c8-wkb8r" podStartSLOduration=2.12949816 podStartE2EDuration="4.312150327s" totalImagesPullingTime="2.182652167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:17.309162631 +0000 UTC m=+126.818801000" watchObservedRunningTime="2026-09-18 13:21:17.312150327 +0000 UTC m=+126.821788693" Sep 18 13:21:18.317248 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.317211 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-797b59f554-wzj4c"] Sep 18 13:21:18.320446 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.320416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.342024 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.341956 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797b59f554-wzj4c"] Sep 18 13:21:18.427089 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.426902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq6pm\" (UniqueName: \"kubernetes.io/projected/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-kube-api-access-mq6pm\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.427089 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.426971 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-service-ca\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.427089 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.427011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-oauth-config\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.427089 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.427045 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-serving-cert\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.427089 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.427066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-oauth-serving-cert\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.427459 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.427143 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-trusted-ca-bundle\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.427459 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.427207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-config\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.528116 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.528081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq6pm\" (UniqueName: \"kubernetes.io/projected/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-kube-api-access-mq6pm\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.528289 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.528126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-service-ca\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.528289 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.528146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-oauth-config\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.528289 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.528187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-serving-cert\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.528289 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.528211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-oauth-serving-cert\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.528289 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.528263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-trusted-ca-bundle\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.528548 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.528336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-config\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.529010 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.528980 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-service-ca\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.529128 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.528982 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-config\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.529128 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.529070 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-oauth-serving-cert\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.529384 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.529360 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-trusted-ca-bundle\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.531130 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.531108 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-serving-cert\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.531300 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.531280 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-oauth-config\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.538296 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.538251 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq6pm\" (UniqueName: \"kubernetes.io/projected/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-kube-api-access-mq6pm\") pod \"console-797b59f554-wzj4c\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:18.631094 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:18.630989 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:19.254456 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:19.254416 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:19.278893 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:19.278858 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerStarted","Data":"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1"} Sep 18 13:21:19.279052 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:19.278941 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerStarted","Data":"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1"} Sep 18 13:21:19.327908 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:19.327869 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797b59f554-wzj4c"] Sep 18 13:21:19.350821 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:19.350792 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:20.285130 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:20.285099 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797b59f554-wzj4c" event={"ID":"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f","Type":"ContainerStarted","Data":"aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb"} Sep 18 13:21:20.285292 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:20.285180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797b59f554-wzj4c" event={"ID":"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f","Type":"ContainerStarted","Data":"325ee92e917898785bb1a77399bd8b738439f1ecd42078b482b1f472bad6b9ef"} Sep 18 13:21:20.318995 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:20.318929 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-797b59f554-wzj4c" podStartSLOduration=2.318913491 podStartE2EDuration="2.318913491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:20.317270671 +0000 UTC m=+129.826909037" watchObservedRunningTime="2026-09-18 13:21:20.318913491 +0000 UTC m=+129.828551868" Sep 18 13:21:21.093362 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.093271 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:21.190457 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.190415 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:21.292336 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.292305 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerStarted","Data":"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf"} Sep 18 13:21:21.292464 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.292370 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerStarted","Data":"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427"} Sep 18 13:21:21.292464 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.292397 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerStarted","Data":"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f"} Sep 18 13:21:21.292464 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.292421 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerStarted","Data":"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119"} Sep 18 13:21:21.329774 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.329698 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.878424077 podStartE2EDuration="7.329675011s" totalImagesPullingTime="4.427015053s" totalInitContainerRuntime="24.235881ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:21.328334251 +0000 UTC m=+130.837972617" watchObservedRunningTime="2026-09-18 13:21:21.329675011 +0000 UTC m=+130.839313403" Sep 18 13:21:21.459062 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.458981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:21:21.461277 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.461247 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e79de33-0f2f-4207-9ea9-276b1f3744f2-metrics-certs\") pod \"network-metrics-daemon-mkf52\" (UID: \"7e79de33-0f2f-4207-9ea9-276b1f3744f2\") " pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:21:21.549370 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.549331 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zvkg5\"" Sep 18 13:21:21.556780 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.556755 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkf52" Sep 18 13:21:21.829360 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:21.829336 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mkf52"] Sep 18 13:21:21.831334 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:21:21.831306 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e79de33_0f2f_4207_9ea9_276b1f3744f2.slice/crio-08976b7228db32bc513fe2c1e02846bc0301a0a5fe4cc54e2cf186e602621163 WatchSource:0}: Error finding container 08976b7228db32bc513fe2c1e02846bc0301a0a5fe4cc54e2cf186e602621163: Status 404 returned error can't find the container with id 08976b7228db32bc513fe2c1e02846bc0301a0a5fe4cc54e2cf186e602621163 Sep 18 13:21:22.300874 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:22.300827 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkf52" event={"ID":"7e79de33-0f2f-4207-9ea9-276b1f3744f2","Type":"ContainerStarted","Data":"08976b7228db32bc513fe2c1e02846bc0301a0a5fe4cc54e2cf186e602621163"} Sep 18 13:21:23.306543 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:23.306506 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkf52" event={"ID":"7e79de33-0f2f-4207-9ea9-276b1f3744f2","Type":"ContainerStarted","Data":"edb0de6d5eb898c232bfd24e34cc7a80f85f4d6962cefd7e9cf43d202c822b50"} Sep 18 13:21:23.306939 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:23.306560 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkf52" event={"ID":"7e79de33-0f2f-4207-9ea9-276b1f3744f2","Type":"ContainerStarted","Data":"f08f56ab24b60cfeca27e8b9ca87ff86e3c2fd8a6c3bbea119fd774f62e85b2d"} Sep 18 13:21:23.327781 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:23.327732 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mkf52" podStartSLOduration=130.486034665 podStartE2EDuration="2m11.327704202s" totalImagesPullingTime="841.669537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:23.326171905 +0000 UTC m=+132.835810477" watchObservedRunningTime="2026-09-18 13:21:23.327704202 +0000 UTC m=+132.837342575" Sep 18 13:21:23.440555 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:23.440504 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:23.545555 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:23.545524 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:24.923355 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:24.923323 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:24.981858 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:24.981827 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:21:25.053973 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:25.053941 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:27.040157 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:27.040122 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:27.116680 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:27.116638 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:28.631306 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:28.631273 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:28.631817 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:28.631368 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:28.636001 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:28.635982 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:29.175788 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:29.175745 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:29.210258 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:29.210229 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tvqnd_dbab27f6-d66f-44e0-9a48-556495083572/serve-healthcheck-canary/0.log" Sep 18 13:21:29.333624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:29.333597 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:21:29.411249 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:29.411217 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:29.426188 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:29.426109 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-749c7cf8f7-fql8b"] Sep 18 13:21:29.578550 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:29.578512 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:29.688948 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:29.688856 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:29.832232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:29.832196 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:29.916515 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:29.916483 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:32.273767 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:32.273690 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86dd54558d-hfqfv" podUID="2f2f420a-1930-40e1-96fc-1894323ca265" containerName="console" containerID="cri-o://2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f" gracePeriod=15 Sep 18 13:21:33.019335 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.019302 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:21:33.178537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.178448 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-oauth-serving-cert\") pod \"2f2f420a-1930-40e1-96fc-1894323ca265\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " Sep 18 13:21:33.178537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.178505 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-service-ca\") pod \"2f2f420a-1930-40e1-96fc-1894323ca265\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " Sep 18 13:21:33.178768 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.178553 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gmrg\" (UniqueName: \"kubernetes.io/projected/2f2f420a-1930-40e1-96fc-1894323ca265-kube-api-access-2gmrg\") pod \"2f2f420a-1930-40e1-96fc-1894323ca265\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " Sep 18 13:21:33.178768 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.178624 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-serving-cert\") pod \"2f2f420a-1930-40e1-96fc-1894323ca265\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " Sep 18 13:21:33.178768 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.178644 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-console-config\") pod \"2f2f420a-1930-40e1-96fc-1894323ca265\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " Sep 18 13:21:33.178768 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.178669 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-oauth-config\") pod \"2f2f420a-1930-40e1-96fc-1894323ca265\" (UID: \"2f2f420a-1930-40e1-96fc-1894323ca265\") " Sep 18 13:21:33.179052 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.179020 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f2f420a-1930-40e1-96fc-1894323ca265" (UID: "2f2f420a-1930-40e1-96fc-1894323ca265"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:21:33.179120 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.179068 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f2f420a-1930-40e1-96fc-1894323ca265" (UID: "2f2f420a-1930-40e1-96fc-1894323ca265"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:21:33.179120 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.179074 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-console-config" (OuterVolumeSpecName: "console-config") pod "2f2f420a-1930-40e1-96fc-1894323ca265" (UID: "2f2f420a-1930-40e1-96fc-1894323ca265"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:21:33.181055 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.181032 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f2f420a-1930-40e1-96fc-1894323ca265" (UID: "2f2f420a-1930-40e1-96fc-1894323ca265"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:21:33.181118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.181053 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f2f420a-1930-40e1-96fc-1894323ca265-kube-api-access-2gmrg" (OuterVolumeSpecName: "kube-api-access-2gmrg") pod "2f2f420a-1930-40e1-96fc-1894323ca265" (UID: "2f2f420a-1930-40e1-96fc-1894323ca265"). InnerVolumeSpecName "kube-api-access-2gmrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:21:33.181118 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.181058 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f2f420a-1930-40e1-96fc-1894323ca265" (UID: "2f2f420a-1930-40e1-96fc-1894323ca265"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:21:33.279278 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.279234 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gmrg\" (UniqueName: \"kubernetes.io/projected/2f2f420a-1930-40e1-96fc-1894323ca265-kube-api-access-2gmrg\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:33.279278 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.279270 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-serving-cert\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:33.279278 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.279283 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-console-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:33.279707 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.279296 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f2f420a-1930-40e1-96fc-1894323ca265-console-oauth-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:33.279707 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.279310 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-oauth-serving-cert\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:33.279707 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.279320 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f2f420a-1930-40e1-96fc-1894323ca265-service-ca\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:33.347095 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.347061 2580 generic.go:356] "Generic (PLEG): container finished" podID="2f2f420a-1930-40e1-96fc-1894323ca265" containerID="2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f" exitCode=0 Sep 18 13:21:33.347232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.347105 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86dd54558d-hfqfv" Sep 18 13:21:33.347232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.347134 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86dd54558d-hfqfv" event={"ID":"2f2f420a-1930-40e1-96fc-1894323ca265","Type":"ContainerDied","Data":"2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f"} Sep 18 13:21:33.347232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.347178 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86dd54558d-hfqfv" event={"ID":"2f2f420a-1930-40e1-96fc-1894323ca265","Type":"ContainerDied","Data":"ccd94fb1102efc0eec18aca1123a52636ce0ede9c9d1b91dbf1eae68d623c2c0"} Sep 18 13:21:33.347232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.347201 2580 scope.go:117] "RemoveContainer" containerID="2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f" Sep 18 13:21:33.358846 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.358817 2580 scope.go:117] "RemoveContainer" containerID="2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f" Sep 18 13:21:33.359475 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:21:33.359443 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f\": container with ID starting with 2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f not found: ID does not exist" containerID="2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f" Sep 18 13:21:33.359591 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.359490 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f"} err="failed to get container status \"2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f\": rpc error: code = NotFound desc = could not find container \"2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f\": container with ID starting with 2cbe205f10c531e2da02ae046692c960caca1ac6c4a81343a23aefab7f0ea70f not found: ID does not exist" Sep 18 13:21:33.371399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.371375 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86dd54558d-hfqfv"] Sep 18 13:21:33.375902 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:33.375880 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86dd54558d-hfqfv"] Sep 18 13:21:34.630134 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:34.630097 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f2f420a-1930-40e1-96fc-1894323ca265" path="/var/lib/kubelet/pods/2f2f420a-1930-40e1-96fc-1894323ca265/volumes" Sep 18 13:21:34.893921 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:34.893831 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" podUID="2efc3662-9438-4c9a-8d83-258d5fe21c8f" containerName="registry" containerID="cri-o://78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7" gracePeriod=30 Sep 18 13:21:35.131961 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.131939 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:21:35.296893 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.296865 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5g5h\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-kube-api-access-p5g5h\") pod \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " Sep 18 13:21:35.297081 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.296910 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") pod \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " Sep 18 13:21:35.297081 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.296947 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-trusted-ca\") pod \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " Sep 18 13:21:35.297081 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.296984 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-image-registry-private-configuration\") pod \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " Sep 18 13:21:35.297081 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.297029 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-bound-sa-token\") pod \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " Sep 18 13:21:35.297081 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.297072 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-certificates\") pod \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " Sep 18 13:21:35.297410 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.297114 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-installation-pull-secrets\") pod \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " Sep 18 13:21:35.297410 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.297147 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2efc3662-9438-4c9a-8d83-258d5fe21c8f-ca-trust-extracted\") pod \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\" (UID: \"2efc3662-9438-4c9a-8d83-258d5fe21c8f\") " Sep 18 13:21:35.297592 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.297561 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2efc3662-9438-4c9a-8d83-258d5fe21c8f" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:21:35.297658 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.297581 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2efc3662-9438-4c9a-8d83-258d5fe21c8f" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:21:35.298076 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.298053 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-certificates\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:35.298217 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.298200 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2efc3662-9438-4c9a-8d83-258d5fe21c8f-trusted-ca\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:35.300001 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.299974 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2efc3662-9438-4c9a-8d83-258d5fe21c8f" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:21:35.300107 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.300042 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2efc3662-9438-4c9a-8d83-258d5fe21c8f" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:21:35.300107 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.300068 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2efc3662-9438-4c9a-8d83-258d5fe21c8f" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:21:35.300107 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.300074 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2efc3662-9438-4c9a-8d83-258d5fe21c8f" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:21:35.300215 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.300139 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-kube-api-access-p5g5h" (OuterVolumeSpecName: "kube-api-access-p5g5h") pod "2efc3662-9438-4c9a-8d83-258d5fe21c8f" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f"). InnerVolumeSpecName "kube-api-access-p5g5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:21:35.305974 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.305950 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2efc3662-9438-4c9a-8d83-258d5fe21c8f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2efc3662-9438-4c9a-8d83-258d5fe21c8f" (UID: "2efc3662-9438-4c9a-8d83-258d5fe21c8f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:21:35.359584 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.359549 2580 generic.go:356] "Generic (PLEG): container finished" podID="2efc3662-9438-4c9a-8d83-258d5fe21c8f" containerID="78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7" exitCode=0 Sep 18 13:21:35.359755 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.359592 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" Sep 18 13:21:35.359755 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.359640 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" event={"ID":"2efc3662-9438-4c9a-8d83-258d5fe21c8f","Type":"ContainerDied","Data":"78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7"} Sep 18 13:21:35.359755 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.359687 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b848d8c94-2k2x9" event={"ID":"2efc3662-9438-4c9a-8d83-258d5fe21c8f","Type":"ContainerDied","Data":"3504d4619df44029d3225c250b4e9110971259ed4e0208fbde209895a91f79d8"} Sep 18 13:21:35.359755 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.359708 2580 scope.go:117] "RemoveContainer" containerID="78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7" Sep 18 13:21:35.368426 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.368408 2580 scope.go:117] "RemoveContainer" containerID="78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7" Sep 18 13:21:35.368680 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:21:35.368663 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7\": container with ID starting with 78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7 not found: ID does not exist" containerID="78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7" Sep 18 13:21:35.368834 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.368689 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7"} err="failed to get container status \"78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7\": rpc error: code = NotFound desc = could not find container \"78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7\": container with ID starting with 78d3a0305daf003fcefc243b3227cc7449a73042fb0cafeea6f898f8413d17b7 not found: ID does not exist" Sep 18 13:21:35.383063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.383038 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b848d8c94-2k2x9"] Sep 18 13:21:35.384534 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.384513 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b848d8c94-2k2x9"] Sep 18 13:21:35.398622 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.398601 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-image-registry-private-configuration\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:35.398729 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.398624 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-bound-sa-token\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:35.398729 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.398640 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2efc3662-9438-4c9a-8d83-258d5fe21c8f-installation-pull-secrets\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:35.398729 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.398655 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2efc3662-9438-4c9a-8d83-258d5fe21c8f-ca-trust-extracted\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:35.398729 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.398668 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5g5h\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-kube-api-access-p5g5h\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:35.398729 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:35.398680 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2efc3662-9438-4c9a-8d83-258d5fe21c8f-registry-tls\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:36.107135 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:36.107091 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:36.212462 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:36.212432 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:36.281581 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:36.281546 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:21:36.625068 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:36.625034 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2efc3662-9438-4c9a-8d83-258d5fe21c8f" path="/var/lib/kubelet/pods/2efc3662-9438-4c9a-8d83-258d5fe21c8f/volumes" Sep 18 13:21:54.445660 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.445573 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-749c7cf8f7-fql8b" podUID="fa4d6428-0db2-46a7-81d0-53b88a9f8df5" containerName="console" containerID="cri-o://1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf" gracePeriod=15 Sep 18 13:21:54.689537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.689514 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:21:54.793824 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.793788 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-config\") pod \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " Sep 18 13:21:54.793973 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.793854 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-oauth-serving-cert\") pod \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " Sep 18 13:21:54.793973 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.793919 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-oauth-config\") pod \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " Sep 18 13:21:54.793973 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.793953 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-service-ca\") pod \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " Sep 18 13:21:54.794127 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.794018 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klv6s\" (UniqueName: \"kubernetes.io/projected/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-kube-api-access-klv6s\") pod \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " Sep 18 13:21:54.794127 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.794059 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-trusted-ca-bundle\") pod \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " Sep 18 13:21:54.794127 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.794100 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-serving-cert\") pod \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\" (UID: \"fa4d6428-0db2-46a7-81d0-53b88a9f8df5\") " Sep 18 13:21:54.794279 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.794251 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-config" (OuterVolumeSpecName: "console-config") pod "fa4d6428-0db2-46a7-81d0-53b88a9f8df5" (UID: "fa4d6428-0db2-46a7-81d0-53b88a9f8df5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:21:54.794369 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.794346 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:54.794609 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.794348 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fa4d6428-0db2-46a7-81d0-53b88a9f8df5" (UID: "fa4d6428-0db2-46a7-81d0-53b88a9f8df5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:21:54.794609 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.794567 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-service-ca" (OuterVolumeSpecName: "service-ca") pod "fa4d6428-0db2-46a7-81d0-53b88a9f8df5" (UID: "fa4d6428-0db2-46a7-81d0-53b88a9f8df5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:21:54.794609 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.794585 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fa4d6428-0db2-46a7-81d0-53b88a9f8df5" (UID: "fa4d6428-0db2-46a7-81d0-53b88a9f8df5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:21:54.796169 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.796146 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fa4d6428-0db2-46a7-81d0-53b88a9f8df5" (UID: "fa4d6428-0db2-46a7-81d0-53b88a9f8df5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:21:54.796289 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.796270 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fa4d6428-0db2-46a7-81d0-53b88a9f8df5" (UID: "fa4d6428-0db2-46a7-81d0-53b88a9f8df5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:21:54.796407 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.796385 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-kube-api-access-klv6s" (OuterVolumeSpecName: "kube-api-access-klv6s") pod "fa4d6428-0db2-46a7-81d0-53b88a9f8df5" (UID: "fa4d6428-0db2-46a7-81d0-53b88a9f8df5"). InnerVolumeSpecName "kube-api-access-klv6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:21:54.895414 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.895369 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-oauth-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:54.895414 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.895404 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-service-ca\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:54.895414 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.895414 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klv6s\" (UniqueName: \"kubernetes.io/projected/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-kube-api-access-klv6s\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:54.895414 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.895422 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-trusted-ca-bundle\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:54.895662 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.895431 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-console-serving-cert\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:54.895662 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:54.895439 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa4d6428-0db2-46a7-81d0-53b88a9f8df5-oauth-serving-cert\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:21:55.450731 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:55.450679 2580 generic.go:356] "Generic (PLEG): container finished" podID="fa4d6428-0db2-46a7-81d0-53b88a9f8df5" containerID="1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf" exitCode=0 Sep 18 13:21:55.451160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:55.450739 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749c7cf8f7-fql8b" Sep 18 13:21:55.451160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:55.450741 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749c7cf8f7-fql8b" event={"ID":"fa4d6428-0db2-46a7-81d0-53b88a9f8df5","Type":"ContainerDied","Data":"1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf"} Sep 18 13:21:55.451160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:55.450794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749c7cf8f7-fql8b" event={"ID":"fa4d6428-0db2-46a7-81d0-53b88a9f8df5","Type":"ContainerDied","Data":"8b2474d3137abe5c180f7ecb8ba7fea46c3b385e8d0114f8e692056e297ba2b9"} Sep 18 13:21:55.451160 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:55.450817 2580 scope.go:117] "RemoveContainer" containerID="1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf" Sep 18 13:21:55.459833 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:55.459821 2580 scope.go:117] "RemoveContainer" containerID="1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf" Sep 18 13:21:55.460107 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:21:55.460090 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf\": container with ID starting with 1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf not found: ID does not exist" containerID="1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf" Sep 18 13:21:55.460164 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:55.460115 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf"} err="failed to get container status \"1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf\": rpc error: code = NotFound desc = could not find container \"1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf\": container with ID starting with 1d0fbf00ff538baa9f23011c5f985320b88fb3d63eca68ab3580d289e5247dcf not found: ID does not exist" Sep 18 13:21:55.474111 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:55.474089 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-749c7cf8f7-fql8b"] Sep 18 13:21:55.480563 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:55.480538 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-749c7cf8f7-fql8b"] Sep 18 13:21:56.625385 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:21:56.625353 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa4d6428-0db2-46a7-81d0-53b88a9f8df5" path="/var/lib/kubelet/pods/fa4d6428-0db2-46a7-81d0-53b88a9f8df5/volumes" Sep 18 13:22:14.981702 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:14.981658 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:15.000877 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:15.000851 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:15.183249 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:15.183215 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:15.549653 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:15.549617 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:24.500126 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:24.500081 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:24.569015 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:24.568979 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:28.962896 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:28.962859 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:22:28.963366 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:28.963157 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="alertmanager" containerID="cri-o://fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f" gracePeriod=120 Sep 18 13:22:28.963366 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:28.963238 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy-web" containerID="cri-o://b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1" gracePeriod=120 Sep 18 13:22:28.963366 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:28.963234 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy-metric" containerID="cri-o://82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734" gracePeriod=120 Sep 18 13:22:28.963366 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:28.963266 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy" containerID="cri-o://473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8" gracePeriod=120 Sep 18 13:22:28.963366 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:28.963283 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="prom-label-proxy" containerID="cri-o://427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc" gracePeriod=120 Sep 18 13:22:28.963366 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:28.963328 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="config-reloader" containerID="cri-o://ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308" gracePeriod=120 Sep 18 13:22:29.591709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:29.591678 2580 generic.go:356] "Generic (PLEG): container finished" podID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerID="427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc" exitCode=0 Sep 18 13:22:29.591709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:29.591704 2580 generic.go:356] "Generic (PLEG): container finished" podID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerID="82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734" exitCode=0 Sep 18 13:22:29.591709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:29.591711 2580 generic.go:356] "Generic (PLEG): container finished" podID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerID="473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8" exitCode=0 Sep 18 13:22:29.591709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:29.591730 2580 generic.go:356] "Generic (PLEG): container finished" podID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerID="ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308" exitCode=0 Sep 18 13:22:29.591987 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:29.591738 2580 generic.go:356] "Generic (PLEG): container finished" podID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerID="fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f" exitCode=0 Sep 18 13:22:29.591987 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:29.591745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerDied","Data":"427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc"} Sep 18 13:22:29.591987 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:29.591810 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerDied","Data":"82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734"} Sep 18 13:22:29.591987 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:29.591836 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerDied","Data":"473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8"} Sep 18 13:22:29.591987 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:29.591859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerDied","Data":"ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308"} Sep 18 13:22:29.591987 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:29.591884 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerDied","Data":"fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f"} Sep 18 13:22:30.214349 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.214323 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.302424 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302390 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-cluster-tls-config\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.302604 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302429 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-trusted-ca-bundle\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.302604 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302498 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-web\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.302604 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302532 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-metrics-client-ca\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.302805 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302629 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-config-out\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.302805 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302668 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-config-volume\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.302805 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302705 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-web-config\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.302805 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302783 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-main-db\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.303011 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302834 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.303011 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302866 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-tls-assets\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.303011 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302892 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-main-tls\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.303011 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302917 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6sth\" (UniqueName: \"kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-kube-api-access-t6sth\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.303011 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302960 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"577cccdd-bb78-4449-befe-4d7c2a11217c\" (UID: \"577cccdd-bb78-4449-befe-4d7c2a11217c\") " Sep 18 13:22:30.303011 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302958 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:22:30.303011 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.302966 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:22:30.303353 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.303227 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.303353 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.303248 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/577cccdd-bb78-4449-befe-4d7c2a11217c-metrics-client-ca\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.303469 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.303353 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:22:30.305875 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.305845 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:30.306092 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.306034 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:22:30.306180 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.306130 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:30.306421 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.306387 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-config-out" (OuterVolumeSpecName: "config-out") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:22:30.306864 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.306838 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:30.307145 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.307128 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-config-volume" (OuterVolumeSpecName: "config-volume") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:30.308070 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.308042 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:30.308547 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.308526 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-kube-api-access-t6sth" (OuterVolumeSpecName: "kube-api-access-t6sth") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "kube-api-access-t6sth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:22:30.310220 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.310191 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:30.317691 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.317638 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-web-config" (OuterVolumeSpecName: "web-config") pod "577cccdd-bb78-4449-befe-4d7c2a11217c" (UID: "577cccdd-bb78-4449-befe-4d7c2a11217c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:30.404275 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404224 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-web-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.404275 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404269 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-alertmanager-main-db\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.404275 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404281 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.404275 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404291 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-tls-assets\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.404537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404300 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-main-tls\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.404537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404309 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6sth\" (UniqueName: \"kubernetes.io/projected/577cccdd-bb78-4449-befe-4d7c2a11217c-kube-api-access-t6sth\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.404537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404317 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.404537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404326 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-cluster-tls-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.404537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404336 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.404537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404345 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/577cccdd-bb78-4449-befe-4d7c2a11217c-config-out\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.404537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.404352 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/577cccdd-bb78-4449-befe-4d7c2a11217c-config-volume\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:30.599492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.599412 2580 generic.go:356] "Generic (PLEG): container finished" podID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerID="b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1" exitCode=0 Sep 18 13:22:30.599492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.599491 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.599662 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.599530 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerDied","Data":"b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1"} Sep 18 13:22:30.599662 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.599602 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"577cccdd-bb78-4449-befe-4d7c2a11217c","Type":"ContainerDied","Data":"92684c4483e28291ad34247eeccd9726cdc0b8e4c5ccaa620cf4ffbc2fa51492"} Sep 18 13:22:30.599662 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.599637 2580 scope.go:117] "RemoveContainer" containerID="427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc" Sep 18 13:22:30.607296 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.607274 2580 scope.go:117] "RemoveContainer" containerID="82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734" Sep 18 13:22:30.614208 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.614190 2580 scope.go:117] "RemoveContainer" containerID="473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8" Sep 18 13:22:30.620532 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.620514 2580 scope.go:117] "RemoveContainer" containerID="b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1" Sep 18 13:22:30.626756 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.626677 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:22:30.627955 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.627933 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:22:30.628585 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.628561 2580 scope.go:117] "RemoveContainer" containerID="ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308" Sep 18 13:22:30.635848 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.635829 2580 scope.go:117] "RemoveContainer" containerID="fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f" Sep 18 13:22:30.642571 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.642555 2580 scope.go:117] "RemoveContainer" containerID="dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1" Sep 18 13:22:30.649380 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.649362 2580 scope.go:117] "RemoveContainer" containerID="427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc" Sep 18 13:22:30.649644 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:30.649626 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc\": container with ID starting with 427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc not found: ID does not exist" containerID="427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc" Sep 18 13:22:30.649700 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.649652 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc"} err="failed to get container status \"427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc\": rpc error: code = NotFound desc = could not find container \"427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc\": container with ID starting with 427aeb5b30a1aac2a2ba3c7e482e7ef0e063105243428ed0cafccfd6979e16fc not found: ID does not exist" Sep 18 13:22:30.649700 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.649670 2580 scope.go:117] "RemoveContainer" containerID="82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734" Sep 18 13:22:30.649976 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:30.649950 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734\": container with ID starting with 82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734 not found: ID does not exist" containerID="82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734" Sep 18 13:22:30.650023 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.649981 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734"} err="failed to get container status \"82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734\": rpc error: code = NotFound desc = could not find container \"82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734\": container with ID starting with 82b97cdda81c0fdde6b834318b61ae760ddc0f11dfbaeff807f9c371b0415734 not found: ID does not exist" Sep 18 13:22:30.650023 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.649999 2580 scope.go:117] "RemoveContainer" containerID="473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8" Sep 18 13:22:30.650254 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:30.650239 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8\": container with ID starting with 473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8 not found: ID does not exist" containerID="473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8" Sep 18 13:22:30.650293 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.650257 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8"} err="failed to get container status \"473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8\": rpc error: code = NotFound desc = could not find container \"473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8\": container with ID starting with 473e9167e3e443373b227cde0c0619197ca694c1c75b35a4bc50de92ff1ab9f8 not found: ID does not exist" Sep 18 13:22:30.650293 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.650270 2580 scope.go:117] "RemoveContainer" containerID="b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1" Sep 18 13:22:30.650514 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:30.650500 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1\": container with ID starting with b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1 not found: ID does not exist" containerID="b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1" Sep 18 13:22:30.650561 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.650516 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1"} err="failed to get container status \"b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1\": rpc error: code = NotFound desc = could not find container \"b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1\": container with ID starting with b563a2b179dc720fa724a7b6505a1f35a2a2da621a7b6d22f7f5f67e5af29bb1 not found: ID does not exist" Sep 18 13:22:30.650561 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.650536 2580 scope.go:117] "RemoveContainer" containerID="ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308" Sep 18 13:22:30.650788 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:30.650772 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308\": container with ID starting with ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308 not found: ID does not exist" containerID="ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308" Sep 18 13:22:30.650836 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.650791 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308"} err="failed to get container status \"ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308\": rpc error: code = NotFound desc = could not find container \"ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308\": container with ID starting with ada0ad5f8d4e60d23c349d807d7cf6c80f5fb8568b306c771bc274bd3a380308 not found: ID does not exist" Sep 18 13:22:30.650836 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.650803 2580 scope.go:117] "RemoveContainer" containerID="fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f" Sep 18 13:22:30.651023 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:30.651006 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f\": container with ID starting with fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f not found: ID does not exist" containerID="fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f" Sep 18 13:22:30.651058 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.651028 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f"} err="failed to get container status \"fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f\": rpc error: code = NotFound desc = could not find container \"fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f\": container with ID starting with fbae537c83341059910dbf30b88966386b2684f53615c4e0e451cd53ceef074f not found: ID does not exist" Sep 18 13:22:30.651058 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.651042 2580 scope.go:117] "RemoveContainer" containerID="dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1" Sep 18 13:22:30.651280 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:30.651263 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1\": container with ID starting with dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1 not found: ID does not exist" containerID="dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1" Sep 18 13:22:30.651324 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.651284 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1"} err="failed to get container status \"dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1\": rpc error: code = NotFound desc = could not find container \"dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1\": container with ID starting with dc576cc46a33b9db75b372a80a4fd9d9ca6667bee13ee6d282924697c14b24b1 not found: ID does not exist" Sep 18 13:22:30.654831 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.654809 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:22:30.655137 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655121 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy-web" Sep 18 13:22:30.655207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655140 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy-web" Sep 18 13:22:30.655207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655154 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy" Sep 18 13:22:30.655207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655163 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy" Sep 18 13:22:30.655207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655186 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2efc3662-9438-4c9a-8d83-258d5fe21c8f" containerName="registry" Sep 18 13:22:30.655207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655195 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2efc3662-9438-4c9a-8d83-258d5fe21c8f" containerName="registry" Sep 18 13:22:30.655207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655205 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4d6428-0db2-46a7-81d0-53b88a9f8df5" containerName="console" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655214 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4d6428-0db2-46a7-81d0-53b88a9f8df5" containerName="console" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655223 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy-metric" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655232 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy-metric" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655243 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="init-config-reloader" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655252 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="init-config-reloader" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655261 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="alertmanager" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655269 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="alertmanager" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655285 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f2f420a-1930-40e1-96fc-1894323ca265" containerName="console" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655294 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f2f420a-1930-40e1-96fc-1894323ca265" containerName="console" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655305 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="config-reloader" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655313 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="config-reloader" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655326 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="prom-label-proxy" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655334 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="prom-label-proxy" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655412 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa4d6428-0db2-46a7-81d0-53b88a9f8df5" containerName="console" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655425 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="alertmanager" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655436 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="prom-label-proxy" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655444 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2efc3662-9438-4c9a-8d83-258d5fe21c8f" containerName="registry" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655453 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy-web" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655462 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="config-reloader" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655471 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655481 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f2f420a-1930-40e1-96fc-1894323ca265" containerName="console" Sep 18 13:22:30.655510 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.655489 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" containerName="kube-rbac-proxy-metric" Sep 18 13:22:30.662805 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.662782 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.665682 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.665662 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 13:22:30.665803 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.665664 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 13:22:30.665946 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.665928 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 13:22:30.666020 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.665944 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 13:22:30.666020 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.665979 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 13:22:30.666126 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.666086 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 13:22:30.666179 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.666159 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 13:22:30.666179 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.666170 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tlzwd\"" Sep 18 13:22:30.666269 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.666219 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 13:22:30.671040 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.671024 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 13:22:30.674037 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.674017 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:22:30.807377 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807341 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-web-config\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-config-volume\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faf1f3f4-f273-4909-9955-192d911d148b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807549 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/faf1f3f4-f273-4909-9955-192d911d148b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807807 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htsgh\" (UniqueName: \"kubernetes.io/projected/faf1f3f4-f273-4909-9955-192d911d148b-kube-api-access-htsgh\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807807 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807807 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807807 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807683 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faf1f3f4-f273-4909-9955-192d911d148b-config-out\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807807 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faf1f3f4-f273-4909-9955-192d911d148b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807807 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807795 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faf1f3f4-f273-4909-9955-192d911d148b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.807980 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.807825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908447 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-config-volume\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908447 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908447 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908695 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faf1f3f4-f273-4909-9955-192d911d148b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908695 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/faf1f3f4-f273-4909-9955-192d911d148b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908695 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908645 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htsgh\" (UniqueName: \"kubernetes.io/projected/faf1f3f4-f273-4909-9955-192d911d148b-kube-api-access-htsgh\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908881 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908881 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908881 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faf1f3f4-f273-4909-9955-192d911d148b-config-out\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908881 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faf1f3f4-f273-4909-9955-192d911d148b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.908881 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908862 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faf1f3f4-f273-4909-9955-192d911d148b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.909132 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.909132 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-web-config\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.909132 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.908970 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/faf1f3f4-f273-4909-9955-192d911d148b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.910229 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.909733 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faf1f3f4-f273-4909-9955-192d911d148b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.910229 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.910171 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faf1f3f4-f273-4909-9955-192d911d148b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.911526 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.911500 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faf1f3f4-f273-4909-9955-192d911d148b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.911966 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.911941 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.912063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.911969 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-config-volume\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.912063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.911991 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.912190 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.912062 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-web-config\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.912190 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.912119 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faf1f3f4-f273-4909-9955-192d911d148b-config-out\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.912459 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.912436 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.912655 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.912640 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.913100 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.913085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faf1f3f4-f273-4909-9955-192d911d148b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.917323 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.917306 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htsgh\" (UniqueName: \"kubernetes.io/projected/faf1f3f4-f273-4909-9955-192d911d148b-kube-api-access-htsgh\") pod \"alertmanager-main-0\" (UID: \"faf1f3f4-f273-4909-9955-192d911d148b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:30.973186 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:30.973137 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 13:22:31.254741 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:31.254697 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 13:22:31.255535 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:22:31.255500 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf1f3f4_f273_4909_9955_192d911d148b.slice/crio-a4e05fae18bde2f10b036d928519a1c4e06d6e329fbb4fb81b3c95339c125666 WatchSource:0}: Error finding container a4e05fae18bde2f10b036d928519a1c4e06d6e329fbb4fb81b3c95339c125666: Status 404 returned error can't find the container with id a4e05fae18bde2f10b036d928519a1c4e06d6e329fbb4fb81b3c95339c125666 Sep 18 13:22:31.606230 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:31.606191 2580 generic.go:356] "Generic (PLEG): container finished" podID="faf1f3f4-f273-4909-9955-192d911d148b" containerID="448b4052c05d32d76510d5facad1578b4e83e5cfe6f85d10aabb5a3035609c56" exitCode=0 Sep 18 13:22:31.606230 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:31.606234 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"faf1f3f4-f273-4909-9955-192d911d148b","Type":"ContainerDied","Data":"448b4052c05d32d76510d5facad1578b4e83e5cfe6f85d10aabb5a3035609c56"} Sep 18 13:22:31.606430 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:31.606290 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"faf1f3f4-f273-4909-9955-192d911d148b","Type":"ContainerStarted","Data":"a4e05fae18bde2f10b036d928519a1c4e06d6e329fbb4fb81b3c95339c125666"} Sep 18 13:22:32.613557 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:32.613519 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"faf1f3f4-f273-4909-9955-192d911d148b","Type":"ContainerStarted","Data":"4b891775d4d89f380975d63f29bde9d7c934b08d503fee5325992e54edc57794"} Sep 18 13:22:32.613960 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:32.613603 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"faf1f3f4-f273-4909-9955-192d911d148b","Type":"ContainerStarted","Data":"f55c38e04af964a0c1ca81e97049dfd062098141cea0c18301b8eaabe1dd7b1b"} Sep 18 13:22:32.613960 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:32.613650 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"faf1f3f4-f273-4909-9955-192d911d148b","Type":"ContainerStarted","Data":"7a3de853672b4fa54cda1db82b2a8f72dc6f1cf98b84557e9b012cd4d8b80391"} Sep 18 13:22:32.613960 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:32.613689 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"faf1f3f4-f273-4909-9955-192d911d148b","Type":"ContainerStarted","Data":"6824ee4405a8f73080a2640cd4e19ece4f9eb39e4c565cb4b1b36c6f8dc1ba57"} Sep 18 13:22:32.613960 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:32.613757 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"faf1f3f4-f273-4909-9955-192d911d148b","Type":"ContainerStarted","Data":"0d49d0ef85f94bbe64e9ce72dd5baa063dc08c43bb04c1e424e2e06cf7b96ceb"} Sep 18 13:22:32.613960 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:32.613794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"faf1f3f4-f273-4909-9955-192d911d148b","Type":"ContainerStarted","Data":"67fb4b5b7e2c647982cccbc77fbc1a64aad6e99842c865ba627d608608c3ed76"} Sep 18 13:22:32.625804 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:32.625776 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="577cccdd-bb78-4449-befe-4d7c2a11217c" path="/var/lib/kubelet/pods/577cccdd-bb78-4449-befe-4d7c2a11217c/volumes" Sep 18 13:22:32.644791 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:32.644709 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.629445267 podStartE2EDuration="2.644683898s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.238631ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:32.642086424 +0000 UTC m=+202.151724792" watchObservedRunningTime="2026-09-18 13:22:32.644683898 +0000 UTC m=+202.154322265" Sep 18 13:22:33.101134 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.101093 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:22:33.101501 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.101448 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy" containerID="cri-o://e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427" gracePeriod=600 Sep 18 13:22:33.101711 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.101443 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="prometheus" containerID="cri-o://e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1" gracePeriod=600 Sep 18 13:22:33.101809 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.101480 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="thanos-sidecar" containerID="cri-o://c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119" gracePeriod=600 Sep 18 13:22:33.101870 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.101520 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf" gracePeriod=600 Sep 18 13:22:33.101921 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.101519 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy-web" containerID="cri-o://e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f" gracePeriod=600 Sep 18 13:22:33.101976 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.101519 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="config-reloader" containerID="cri-o://acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1" gracePeriod=600 Sep 18 13:22:33.346839 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.346814 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.432096 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432008 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432096 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432048 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-db\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432096 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432078 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-metrics-client-ca\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432319 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432101 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-serving-certs-ca-bundle\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432319 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432130 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-metrics-client-certs\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432319 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432152 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-web-config\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432319 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432168 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-kubelet-serving-ca-bundle\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432319 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432286 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-tls\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432324 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-grpc-tls\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432357 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-tls-assets\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432383 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-config-out\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432427 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432452 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-2\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432492 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-0\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432526 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-kube-rbac-proxy\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432572 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432550 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-thanos-prometheus-http-client-file\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432942 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432584 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kjjb\" (UniqueName: \"kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-kube-api-access-9kjjb\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432942 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432632 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-1\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432942 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432682 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-config\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432942 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432712 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-trusted-ca-bundle\") pod \"89b51218-a43b-4839-a373-347622286dd1\" (UID: \"89b51218-a43b-4839-a373-347622286dd1\") " Sep 18 13:22:33.432942 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.432836 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:22:33.433198 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.433050 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-metrics-client-ca\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.435046 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.433331 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:22:33.435046 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.433389 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:22:33.435046 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.433848 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:22:33.435046 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.434252 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:22:33.436263 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.434808 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:22:33.436263 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.435382 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:22:33.436263 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.435510 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:22:33.438182 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438147 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:33.438276 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438202 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:33.438276 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438235 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:33.438276 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438256 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:33.438452 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438279 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:33.438674 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438574 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:22:33.438674 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438651 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-config-out" (OuterVolumeSpecName: "config-out") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:22:33.438816 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438655 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-config" (OuterVolumeSpecName: "config") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:33.438816 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438750 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:33.438884 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438832 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:33.439013 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.438994 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-kube-api-access-9kjjb" (OuterVolumeSpecName: "kube-api-access-9kjjb") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "kube-api-access-9kjjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:22:33.447411 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.447389 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-web-config" (OuterVolumeSpecName: "web-config") pod "89b51218-a43b-4839-a373-347622286dd1" (UID: "89b51218-a43b-4839-a373-347622286dd1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:22:33.534270 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534226 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534270 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534263 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534270 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534273 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534285 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-db\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534295 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534303 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-metrics-client-certs\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534312 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-web-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534320 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534328 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534336 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-grpc-tls\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534344 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-tls-assets\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534351 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89b51218-a43b-4839-a373-347622286dd1-config-out\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534358 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534367 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534375 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534383 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-secret-kube-rbac-proxy\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534392 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89b51218-a43b-4839-a373-347622286dd1-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534404 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kjjb\" (UniqueName: \"kubernetes.io/projected/89b51218-a43b-4839-a373-347622286dd1-kube-api-access-9kjjb\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.534493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.534413 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89b51218-a43b-4839-a373-347622286dd1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:22:33.620975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.620937 2580 generic.go:356] "Generic (PLEG): container finished" podID="89b51218-a43b-4839-a373-347622286dd1" containerID="db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf" exitCode=0 Sep 18 13:22:33.620975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.620964 2580 generic.go:356] "Generic (PLEG): container finished" podID="89b51218-a43b-4839-a373-347622286dd1" containerID="e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427" exitCode=0 Sep 18 13:22:33.620975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.620970 2580 generic.go:356] "Generic (PLEG): container finished" podID="89b51218-a43b-4839-a373-347622286dd1" containerID="e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f" exitCode=0 Sep 18 13:22:33.620975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.620977 2580 generic.go:356] "Generic (PLEG): container finished" podID="89b51218-a43b-4839-a373-347622286dd1" containerID="c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119" exitCode=0 Sep 18 13:22:33.620975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.620982 2580 generic.go:356] "Generic (PLEG): container finished" podID="89b51218-a43b-4839-a373-347622286dd1" containerID="acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1" exitCode=0 Sep 18 13:22:33.620975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.620987 2580 generic.go:356] "Generic (PLEG): container finished" podID="89b51218-a43b-4839-a373-347622286dd1" containerID="e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1" exitCode=0 Sep 18 13:22:33.621652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.621014 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerDied","Data":"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf"} Sep 18 13:22:33.621652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.621025 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.621652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.621092 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerDied","Data":"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427"} Sep 18 13:22:33.621652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.621108 2580 scope.go:117] "RemoveContainer" containerID="db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf" Sep 18 13:22:33.621652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.621137 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerDied","Data":"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f"} Sep 18 13:22:33.621652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.621177 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerDied","Data":"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119"} Sep 18 13:22:33.621652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.621220 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerDied","Data":"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1"} Sep 18 13:22:33.621652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.621256 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerDied","Data":"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1"} Sep 18 13:22:33.621652 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.621281 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89b51218-a43b-4839-a373-347622286dd1","Type":"ContainerDied","Data":"5a066eb0ed53713f8c1765961d9271d0989c1c1b86251d4d10a216735e074b34"} Sep 18 13:22:33.629119 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.629097 2580 scope.go:117] "RemoveContainer" containerID="e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427" Sep 18 13:22:33.636575 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.636555 2580 scope.go:117] "RemoveContainer" containerID="e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f" Sep 18 13:22:33.642937 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.642920 2580 scope.go:117] "RemoveContainer" containerID="c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119" Sep 18 13:22:33.649850 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.649785 2580 scope.go:117] "RemoveContainer" containerID="acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1" Sep 18 13:22:33.653159 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.653135 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:22:33.658406 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.658385 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:22:33.660052 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.660035 2580 scope.go:117] "RemoveContainer" containerID="e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1" Sep 18 13:22:33.667452 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.667434 2580 scope.go:117] "RemoveContainer" containerID="a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4" Sep 18 13:22:33.674420 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.674402 2580 scope.go:117] "RemoveContainer" containerID="db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf" Sep 18 13:22:33.674702 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:33.674683 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": container with ID starting with db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf not found: ID does not exist" containerID="db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf" Sep 18 13:22:33.674773 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.674711 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf"} err="failed to get container status \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": rpc error: code = NotFound desc = could not find container \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": container with ID starting with db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf not found: ID does not exist" Sep 18 13:22:33.674773 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.674748 2580 scope.go:117] "RemoveContainer" containerID="e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427" Sep 18 13:22:33.675009 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:33.674992 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": container with ID starting with e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427 not found: ID does not exist" containerID="e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427" Sep 18 13:22:33.675046 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.675017 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427"} err="failed to get container status \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": rpc error: code = NotFound desc = could not find container \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": container with ID starting with e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427 not found: ID does not exist" Sep 18 13:22:33.675046 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.675034 2580 scope.go:117] "RemoveContainer" containerID="e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f" Sep 18 13:22:33.675270 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:33.675255 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": container with ID starting with e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f not found: ID does not exist" containerID="e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f" Sep 18 13:22:33.675305 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.675275 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f"} err="failed to get container status \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": rpc error: code = NotFound desc = could not find container \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": container with ID starting with e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f not found: ID does not exist" Sep 18 13:22:33.675305 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.675295 2580 scope.go:117] "RemoveContainer" containerID="c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119" Sep 18 13:22:33.675522 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:33.675505 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": container with ID starting with c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119 not found: ID does not exist" containerID="c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119" Sep 18 13:22:33.675560 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.675527 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119"} err="failed to get container status \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": rpc error: code = NotFound desc = could not find container \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": container with ID starting with c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119 not found: ID does not exist" Sep 18 13:22:33.675560 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.675543 2580 scope.go:117] "RemoveContainer" containerID="acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1" Sep 18 13:22:33.675783 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:33.675766 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": container with ID starting with acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1 not found: ID does not exist" containerID="acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1" Sep 18 13:22:33.675819 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.675789 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1"} err="failed to get container status \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": rpc error: code = NotFound desc = could not find container \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": container with ID starting with acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1 not found: ID does not exist" Sep 18 13:22:33.675819 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.675805 2580 scope.go:117] "RemoveContainer" containerID="e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1" Sep 18 13:22:33.676060 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:33.676043 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": container with ID starting with e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1 not found: ID does not exist" containerID="e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1" Sep 18 13:22:33.676100 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.676066 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1"} err="failed to get container status \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": rpc error: code = NotFound desc = could not find container \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": container with ID starting with e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1 not found: ID does not exist" Sep 18 13:22:33.676100 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.676079 2580 scope.go:117] "RemoveContainer" containerID="a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4" Sep 18 13:22:33.676323 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:22:33.676301 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": container with ID starting with a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4 not found: ID does not exist" containerID="a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4" Sep 18 13:22:33.676374 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.676323 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4"} err="failed to get container status \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": rpc error: code = NotFound desc = could not find container \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": container with ID starting with a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4 not found: ID does not exist" Sep 18 13:22:33.676374 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.676338 2580 scope.go:117] "RemoveContainer" containerID="db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf" Sep 18 13:22:33.676567 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.676551 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf"} err="failed to get container status \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": rpc error: code = NotFound desc = could not find container \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": container with ID starting with db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf not found: ID does not exist" Sep 18 13:22:33.676607 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.676567 2580 scope.go:117] "RemoveContainer" containerID="e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427" Sep 18 13:22:33.676793 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.676777 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427"} err="failed to get container status \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": rpc error: code = NotFound desc = could not find container \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": container with ID starting with e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427 not found: ID does not exist" Sep 18 13:22:33.676793 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.676793 2580 scope.go:117] "RemoveContainer" containerID="e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f" Sep 18 13:22:33.677026 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.677003 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f"} err="failed to get container status \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": rpc error: code = NotFound desc = could not find container \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": container with ID starting with e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f not found: ID does not exist" Sep 18 13:22:33.677026 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.677024 2580 scope.go:117] "RemoveContainer" containerID="c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119" Sep 18 13:22:33.677259 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.677244 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119"} err="failed to get container status \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": rpc error: code = NotFound desc = could not find container \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": container with ID starting with c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119 not found: ID does not exist" Sep 18 13:22:33.677304 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.677259 2580 scope.go:117] "RemoveContainer" containerID="acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1" Sep 18 13:22:33.677508 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.677490 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1"} err="failed to get container status \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": rpc error: code = NotFound desc = could not find container \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": container with ID starting with acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1 not found: ID does not exist" Sep 18 13:22:33.677564 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.677509 2580 scope.go:117] "RemoveContainer" containerID="e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1" Sep 18 13:22:33.677712 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.677697 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1"} err="failed to get container status \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": rpc error: code = NotFound desc = could not find container \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": container with ID starting with e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1 not found: ID does not exist" Sep 18 13:22:33.677783 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.677712 2580 scope.go:117] "RemoveContainer" containerID="a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4" Sep 18 13:22:33.677965 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.677951 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4"} err="failed to get container status \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": rpc error: code = NotFound desc = could not find container \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": container with ID starting with a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4 not found: ID does not exist" Sep 18 13:22:33.677965 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.677965 2580 scope.go:117] "RemoveContainer" containerID="db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf" Sep 18 13:22:33.678198 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.678178 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf"} err="failed to get container status \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": rpc error: code = NotFound desc = could not find container \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": container with ID starting with db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf not found: ID does not exist" Sep 18 13:22:33.678198 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.678197 2580 scope.go:117] "RemoveContainer" containerID="e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427" Sep 18 13:22:33.678465 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.678445 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427"} err="failed to get container status \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": rpc error: code = NotFound desc = could not find container \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": container with ID starting with e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427 not found: ID does not exist" Sep 18 13:22:33.678522 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.678470 2580 scope.go:117] "RemoveContainer" containerID="e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f" Sep 18 13:22:33.678772 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.678742 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f"} err="failed to get container status \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": rpc error: code = NotFound desc = could not find container \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": container with ID starting with e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f not found: ID does not exist" Sep 18 13:22:33.678837 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.678774 2580 scope.go:117] "RemoveContainer" containerID="c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119" Sep 18 13:22:33.679063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.679041 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119"} err="failed to get container status \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": rpc error: code = NotFound desc = could not find container \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": container with ID starting with c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119 not found: ID does not exist" Sep 18 13:22:33.679125 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.679064 2580 scope.go:117] "RemoveContainer" containerID="acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1" Sep 18 13:22:33.679349 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.679325 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1"} err="failed to get container status \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": rpc error: code = NotFound desc = could not find container \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": container with ID starting with acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1 not found: ID does not exist" Sep 18 13:22:33.679349 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.679349 2580 scope.go:117] "RemoveContainer" containerID="e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1" Sep 18 13:22:33.679639 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.679620 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1"} err="failed to get container status \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": rpc error: code = NotFound desc = could not find container \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": container with ID starting with e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1 not found: ID does not exist" Sep 18 13:22:33.679688 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.679640 2580 scope.go:117] "RemoveContainer" containerID="a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4" Sep 18 13:22:33.679895 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.679875 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4"} err="failed to get container status \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": rpc error: code = NotFound desc = could not find container \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": container with ID starting with a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4 not found: ID does not exist" Sep 18 13:22:33.679943 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.679895 2580 scope.go:117] "RemoveContainer" containerID="db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf" Sep 18 13:22:33.680135 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.680119 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf"} err="failed to get container status \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": rpc error: code = NotFound desc = could not find container \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": container with ID starting with db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf not found: ID does not exist" Sep 18 13:22:33.680174 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.680137 2580 scope.go:117] "RemoveContainer" containerID="e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427" Sep 18 13:22:33.680341 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.680326 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427"} err="failed to get container status \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": rpc error: code = NotFound desc = could not find container \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": container with ID starting with e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427 not found: ID does not exist" Sep 18 13:22:33.680385 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.680342 2580 scope.go:117] "RemoveContainer" containerID="e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f" Sep 18 13:22:33.680574 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.680553 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f"} err="failed to get container status \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": rpc error: code = NotFound desc = could not find container \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": container with ID starting with e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f not found: ID does not exist" Sep 18 13:22:33.680621 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.680577 2580 scope.go:117] "RemoveContainer" containerID="c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119" Sep 18 13:22:33.680819 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.680798 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119"} err="failed to get container status \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": rpc error: code = NotFound desc = could not find container \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": container with ID starting with c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119 not found: ID does not exist" Sep 18 13:22:33.680896 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.680821 2580 scope.go:117] "RemoveContainer" containerID="acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1" Sep 18 13:22:33.681092 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.681076 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1"} err="failed to get container status \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": rpc error: code = NotFound desc = could not find container \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": container with ID starting with acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1 not found: ID does not exist" Sep 18 13:22:33.681139 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.681093 2580 scope.go:117] "RemoveContainer" containerID="e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1" Sep 18 13:22:33.681307 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.681291 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1"} err="failed to get container status \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": rpc error: code = NotFound desc = could not find container \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": container with ID starting with e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1 not found: ID does not exist" Sep 18 13:22:33.681354 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.681309 2580 scope.go:117] "RemoveContainer" containerID="a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4" Sep 18 13:22:33.681532 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.681513 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4"} err="failed to get container status \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": rpc error: code = NotFound desc = could not find container \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": container with ID starting with a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4 not found: ID does not exist" Sep 18 13:22:33.681616 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.681535 2580 scope.go:117] "RemoveContainer" containerID="db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf" Sep 18 13:22:33.681787 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.681766 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf"} err="failed to get container status \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": rpc error: code = NotFound desc = could not find container \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": container with ID starting with db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf not found: ID does not exist" Sep 18 13:22:33.681843 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.681788 2580 scope.go:117] "RemoveContainer" containerID="e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427" Sep 18 13:22:33.682018 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.682002 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427"} err="failed to get container status \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": rpc error: code = NotFound desc = could not find container \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": container with ID starting with e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427 not found: ID does not exist" Sep 18 13:22:33.682074 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.682018 2580 scope.go:117] "RemoveContainer" containerID="e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f" Sep 18 13:22:33.682272 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.682234 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f"} err="failed to get container status \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": rpc error: code = NotFound desc = could not find container \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": container with ID starting with e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f not found: ID does not exist" Sep 18 13:22:33.682272 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.682250 2580 scope.go:117] "RemoveContainer" containerID="c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119" Sep 18 13:22:33.682485 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.682466 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119"} err="failed to get container status \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": rpc error: code = NotFound desc = could not find container \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": container with ID starting with c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119 not found: ID does not exist" Sep 18 13:22:33.682528 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.682488 2580 scope.go:117] "RemoveContainer" containerID="acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1" Sep 18 13:22:33.682745 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.682705 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1"} err="failed to get container status \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": rpc error: code = NotFound desc = could not find container \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": container with ID starting with acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1 not found: ID does not exist" Sep 18 13:22:33.682819 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.682748 2580 scope.go:117] "RemoveContainer" containerID="e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1" Sep 18 13:22:33.683004 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.682985 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1"} err="failed to get container status \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": rpc error: code = NotFound desc = could not find container \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": container with ID starting with e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1 not found: ID does not exist" Sep 18 13:22:33.683065 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.683007 2580 scope.go:117] "RemoveContainer" containerID="a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4" Sep 18 13:22:33.683234 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.683217 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4"} err="failed to get container status \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": rpc error: code = NotFound desc = could not find container \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": container with ID starting with a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4 not found: ID does not exist" Sep 18 13:22:33.683291 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.683236 2580 scope.go:117] "RemoveContainer" containerID="db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf" Sep 18 13:22:33.683419 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.683403 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf"} err="failed to get container status \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": rpc error: code = NotFound desc = could not find container \"db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf\": container with ID starting with db0b01b19abce379f3d9687059a38f5538a4b77800d755c1ba7e6a3990b607cf not found: ID does not exist" Sep 18 13:22:33.683460 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.683419 2580 scope.go:117] "RemoveContainer" containerID="e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427" Sep 18 13:22:33.683634 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.683617 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427"} err="failed to get container status \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": rpc error: code = NotFound desc = could not find container \"e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427\": container with ID starting with e4be93b085b8dc65ab79b2b79b22c5d9bf168ee7301df3d1e9bcd6a226551427 not found: ID does not exist" Sep 18 13:22:33.683708 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.683635 2580 scope.go:117] "RemoveContainer" containerID="e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f" Sep 18 13:22:33.683883 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.683866 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f"} err="failed to get container status \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": rpc error: code = NotFound desc = could not find container \"e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f\": container with ID starting with e22a1ebdcdd43d341d17143a351c4a195cb96f719385094ec5a9fe4fb6ec742f not found: ID does not exist" Sep 18 13:22:33.683948 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.683883 2580 scope.go:117] "RemoveContainer" containerID="c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119" Sep 18 13:22:33.684130 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.684112 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119"} err="failed to get container status \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": rpc error: code = NotFound desc = could not find container \"c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119\": container with ID starting with c48a1e0540beb9809f3724076bca57286efde25069151686e0a733a8e6834119 not found: ID does not exist" Sep 18 13:22:33.684193 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.684131 2580 scope.go:117] "RemoveContainer" containerID="acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1" Sep 18 13:22:33.684361 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.684344 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1"} err="failed to get container status \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": rpc error: code = NotFound desc = could not find container \"acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1\": container with ID starting with acc184b493a554819261938050b875af91581850503b5ff347c0273ed47c50a1 not found: ID does not exist" Sep 18 13:22:33.684410 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.684363 2580 scope.go:117] "RemoveContainer" containerID="e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1" Sep 18 13:22:33.684571 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.684556 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1"} err="failed to get container status \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": rpc error: code = NotFound desc = could not find container \"e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1\": container with ID starting with e5cfdd7ab2a65cbdf7b15f78957b931416a5ccb08855be537531fd5cee5c2ec1 not found: ID does not exist" Sep 18 13:22:33.684613 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.684571 2580 scope.go:117] "RemoveContainer" containerID="a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4" Sep 18 13:22:33.684783 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.684769 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4"} err="failed to get container status \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": rpc error: code = NotFound desc = could not find container \"a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4\": container with ID starting with a78d3e510e1036aa8b97298f20c039d7bb88ec5cea587d16468eaecd752896c4 not found: ID does not exist" Sep 18 13:22:33.696375 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696353 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:22:33.696648 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696636 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="config-reloader" Sep 18 13:22:33.696688 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696650 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="config-reloader" Sep 18 13:22:33.696688 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696658 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="thanos-sidecar" Sep 18 13:22:33.696688 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696664 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="thanos-sidecar" Sep 18 13:22:33.696688 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696671 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="init-config-reloader" Sep 18 13:22:33.696688 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696677 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="init-config-reloader" Sep 18 13:22:33.696688 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696686 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy-web" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696692 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy-web" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696697 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy-thanos" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696703 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy-thanos" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696710 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="prometheus" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696728 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="prometheus" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696739 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696746 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696807 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy-web" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696817 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696827 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="config-reloader" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696833 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="thanos-sidecar" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696839 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="kube-rbac-proxy-thanos" Sep 18 13:22:33.696897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.696844 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b51218-a43b-4839-a373-347622286dd1" containerName="prometheus" Sep 18 13:22:33.702235 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.702220 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.708605 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.708506 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 13:22:33.708605 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.708546 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 13:22:33.709063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.708819 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 13:22:33.709063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.708819 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 13:22:33.709063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.708862 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 13:22:33.709063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.708868 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 13:22:33.709427 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.709218 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 13:22:33.709427 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.709256 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 13:22:33.709427 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.709315 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 13:22:33.709427 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.709342 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 13:22:33.709681 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.709344 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 13:22:33.709681 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.709357 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-br369i0j1t8sb\"" Sep 18 13:22:33.709681 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.709482 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 13:22:33.709847 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.709815 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-69lxv\"" Sep 18 13:22:33.710112 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.710098 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 13:22:33.711351 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.711336 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 13:22:33.719754 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.719738 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 13:22:33.742287 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.741692 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:22:33.836678 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75cl5\" (UniqueName: \"kubernetes.io/projected/d061626f-8b92-4c07-b4de-615905c7accd-kube-api-access-75cl5\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.836678 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.836954 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.836954 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836756 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-config\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.836954 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836807 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d061626f-8b92-4c07-b4de-615905c7accd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.836954 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-web-config\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.836954 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836915 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.836954 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d061626f-8b92-4c07-b4de-615905c7accd-config-out\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837159 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836961 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837159 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837159 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.836995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837159 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.837020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837159 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.837035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837159 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.837053 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837159 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.837079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837159 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.837099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837159 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.837129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837437 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.837166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837437 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.837246 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.837437 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.837263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.938164 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.938072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.938164 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.938115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d061626f-8b92-4c07-b4de-615905c7accd-config-out\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.938164 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.938144 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.938411 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.938169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.938411 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.938194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.938411 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.938225 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.938411 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.938247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.938411 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.938275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.938988 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.938957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939111 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939025 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939111 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939111 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939270 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939270 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939270 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939219 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939270 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939476 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75cl5\" (UniqueName: \"kubernetes.io/projected/d061626f-8b92-4c07-b4de-615905c7accd-kube-api-access-75cl5\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939476 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939315 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939476 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939476 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-config\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939476 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d061626f-8b92-4c07-b4de-615905c7accd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939476 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-web-config\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939906 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939880 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.939992 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.940236 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.940206 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.940399 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.939112 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.941384 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.941354 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.941384 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.941373 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.941551 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.941359 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.941551 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.941413 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d061626f-8b92-4c07-b4de-615905c7accd-config-out\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.941921 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.941896 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.942358 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.942332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-web-config\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.942655 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.942627 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.943127 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.943102 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d061626f-8b92-4c07-b4de-615905c7accd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.943639 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.943613 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.943709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.943695 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.943848 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.943827 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-config\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.944035 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.944016 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d061626f-8b92-4c07-b4de-615905c7accd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.944165 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.944148 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d061626f-8b92-4c07-b4de-615905c7accd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:33.952489 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:33.952472 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75cl5\" (UniqueName: \"kubernetes.io/projected/d061626f-8b92-4c07-b4de-615905c7accd-kube-api-access-75cl5\") pod \"prometheus-k8s-0\" (UID: \"d061626f-8b92-4c07-b4de-615905c7accd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:34.012434 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:34.012393 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:34.298494 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:34.298442 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:22:34.300938 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:22:34.300901 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd061626f_8b92_4c07_b4de_615905c7accd.slice/crio-aa62a90a02abf2d7be48f4638225796a688e12e1ff97fc8eda6ec514f4e89f0e WatchSource:0}: Error finding container aa62a90a02abf2d7be48f4638225796a688e12e1ff97fc8eda6ec514f4e89f0e: Status 404 returned error can't find the container with id aa62a90a02abf2d7be48f4638225796a688e12e1ff97fc8eda6ec514f4e89f0e Sep 18 13:22:34.625885 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:34.625807 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89b51218-a43b-4839-a373-347622286dd1" path="/var/lib/kubelet/pods/89b51218-a43b-4839-a373-347622286dd1/volumes" Sep 18 13:22:34.627530 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:34.627503 2580 generic.go:356] "Generic (PLEG): container finished" podID="d061626f-8b92-4c07-b4de-615905c7accd" containerID="d26774eb60663b851ad6b434dbe38bc185ac73dce27ecf2eeac7bc86c33398d4" exitCode=0 Sep 18 13:22:34.627619 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:34.627590 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d061626f-8b92-4c07-b4de-615905c7accd","Type":"ContainerDied","Data":"d26774eb60663b851ad6b434dbe38bc185ac73dce27ecf2eeac7bc86c33398d4"} Sep 18 13:22:34.627674 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:34.627662 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d061626f-8b92-4c07-b4de-615905c7accd","Type":"ContainerStarted","Data":"aa62a90a02abf2d7be48f4638225796a688e12e1ff97fc8eda6ec514f4e89f0e"} Sep 18 13:22:35.635854 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:35.635817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d061626f-8b92-4c07-b4de-615905c7accd","Type":"ContainerStarted","Data":"3d56c8ab49cc0113127bc2e92e624a52325eaa6f048b4a8c8b4993464aa2af53"} Sep 18 13:22:35.636207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:35.635900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d061626f-8b92-4c07-b4de-615905c7accd","Type":"ContainerStarted","Data":"ef734a1ac107e3562031afeaa2eb36e0ec7d6191bc1c62b18a388c635a01204c"} Sep 18 13:22:35.636207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:35.635938 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d061626f-8b92-4c07-b4de-615905c7accd","Type":"ContainerStarted","Data":"3b137634fcf4b779f34d853b6203ec2c729aa53e7488f4375d150bd541c382ef"} Sep 18 13:22:35.636207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:35.635978 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d061626f-8b92-4c07-b4de-615905c7accd","Type":"ContainerStarted","Data":"1ac3c41d7abcfcc4587092f6c21a2853e44b5739fe1e71aab06295c28c7aef0f"} Sep 18 13:22:35.636207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:35.636018 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d061626f-8b92-4c07-b4de-615905c7accd","Type":"ContainerStarted","Data":"ded8c0514775d26e90724a66629c423b6976f7643022df6e5851e7127274e098"} Sep 18 13:22:35.636207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:35.636057 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d061626f-8b92-4c07-b4de-615905c7accd","Type":"ContainerStarted","Data":"031cff3c3749ac1d383451dee8eac938115fb7045af92b5fce82afd0af3b4b57"} Sep 18 13:22:35.675018 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:35.674936 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.65664668 podStartE2EDuration="2.67490789s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.26121ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:35.670522938 +0000 UTC m=+205.180161304" watchObservedRunningTime="2026-09-18 13:22:35.67490789 +0000 UTC m=+205.184546257" Sep 18 13:22:36.405404 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:36.405356 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:36.594752 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:36.594695 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:39.013125 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:39.013082 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:22:39.603454 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:39.603416 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:39.724909 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:39.724875 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:40.227041 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:40.226998 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:40.360958 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:40.360929 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:50.391174 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:50.391117 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797b59f554-wzj4c"] Sep 18 13:22:50.640445 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:50.640415 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:50.762571 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:50.762454 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:51.210267 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:51.210233 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:51.331991 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:51.331953 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:58.379982 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:58.379939 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:59.377434 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:59.377398 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:22:59.459742 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:22:59.459693 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:23:15.412125 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.412059 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-797b59f554-wzj4c" podUID="2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" containerName="console" containerID="cri-o://aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb" gracePeriod=15 Sep 18 13:23:15.651037 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.651014 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:23:15.690439 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.690367 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-trusted-ca-bundle\") pod \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " Sep 18 13:23:15.690439 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.690416 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-service-ca\") pod \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " Sep 18 13:23:15.690626 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.690442 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-oauth-serving-cert\") pod \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " Sep 18 13:23:15.690626 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.690475 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-serving-cert\") pod \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " Sep 18 13:23:15.690626 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.690510 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-oauth-config\") pod \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " Sep 18 13:23:15.690626 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.690545 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-config\") pod \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " Sep 18 13:23:15.690626 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.690599 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq6pm\" (UniqueName: \"kubernetes.io/projected/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-kube-api-access-mq6pm\") pod \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\" (UID: \"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f\") " Sep 18 13:23:15.690982 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.690897 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" (UID: "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:23:15.691043 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.690925 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" (UID: "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:23:15.691101 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.690917 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-service-ca" (OuterVolumeSpecName: "service-ca") pod "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" (UID: "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:23:15.691161 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.691109 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-config" (OuterVolumeSpecName: "console-config") pod "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" (UID: "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:23:15.692647 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.692621 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" (UID: "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:23:15.692788 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.692642 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" (UID: "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:23:15.692788 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.692735 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-kube-api-access-mq6pm" (OuterVolumeSpecName: "kube-api-access-mq6pm") pod "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" (UID: "2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f"). InnerVolumeSpecName "kube-api-access-mq6pm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:23:15.791626 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.791585 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq6pm\" (UniqueName: \"kubernetes.io/projected/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-kube-api-access-mq6pm\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:23:15.791626 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.791619 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-trusted-ca-bundle\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:23:15.791626 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.791630 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-service-ca\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:23:15.791626 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.791638 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-oauth-serving-cert\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:23:15.791937 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.791648 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-serving-cert\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:23:15.791937 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.791678 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-oauth-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:23:15.791937 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.791687 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f-console-config\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:23:15.803194 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.803158 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" containerID="aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb" exitCode=0 Sep 18 13:23:15.803337 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.803198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797b59f554-wzj4c" event={"ID":"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f","Type":"ContainerDied","Data":"aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb"} Sep 18 13:23:15.803337 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.803202 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797b59f554-wzj4c" Sep 18 13:23:15.803337 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.803238 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797b59f554-wzj4c" event={"ID":"2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f","Type":"ContainerDied","Data":"325ee92e917898785bb1a77399bd8b738439f1ecd42078b482b1f472bad6b9ef"} Sep 18 13:23:15.803337 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.803259 2580 scope.go:117] "RemoveContainer" containerID="aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb" Sep 18 13:23:15.812017 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.811999 2580 scope.go:117] "RemoveContainer" containerID="aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb" Sep 18 13:23:15.812317 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:23:15.812297 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb\": container with ID starting with aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb not found: ID does not exist" containerID="aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb" Sep 18 13:23:15.812382 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.812325 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb"} err="failed to get container status \"aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb\": rpc error: code = NotFound desc = could not find container \"aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb\": container with ID starting with aef6656b801117a6497a467fe2ddaaa480c20bb2c210d293f2304c4e2b139bdb not found: ID does not exist" Sep 18 13:23:15.830962 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.830938 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797b59f554-wzj4c"] Sep 18 13:23:15.835507 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:15.835483 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-797b59f554-wzj4c"] Sep 18 13:23:16.625435 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:16.625401 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" path="/var/lib/kubelet/pods/2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f/volumes" Sep 18 13:23:24.610270 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:24.610170 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:23:34.012551 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:34.012526 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:23:34.027620 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:34.027596 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:23:34.895531 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:34.895506 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:23:40.939522 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:40.939485 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:23:41.053139 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:41.053103 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:23:46.899604 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:46.899566 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:23:47.000022 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:23:46.999987 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:03.283284 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:03.283240 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:04.206898 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:04.206862 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:07.489206 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:07.489172 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:07.558824 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:07.558797 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:09.962038 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:09.962005 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:10.067991 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:10.067960 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:12.384500 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:12.384456 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:12.528808 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:12.528784 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/1.log" Sep 18 13:24:12.536131 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:12.536103 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/1.log" Sep 18 13:24:12.537969 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:12.537947 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 13:24:12.794445 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:12.794415 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:20.586696 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:20.586664 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:21.427605 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.427571 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j2cvg"] Sep 18 13:24:21.427937 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.427923 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" containerName="console" Sep 18 13:24:21.427995 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.427938 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" containerName="console" Sep 18 13:24:21.428034 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.428000 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e60a4b0-cfcc-4bda-ab4c-0b9002feb87f" containerName="console" Sep 18 13:24:21.430760 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.430736 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j2cvg" Sep 18 13:24:21.435750 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.435711 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7j4tp\"" Sep 18 13:24:21.436144 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.436111 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 13:24:21.437349 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.437037 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 13:24:21.445513 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.445491 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j2cvg"] Sep 18 13:24:21.541631 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.541605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c57f806c-237b-4f3c-bd4b-7c5181b41922-bound-sa-token\") pod \"cert-manager-55b4d954d5-j2cvg\" (UID: \"c57f806c-237b-4f3c-bd4b-7c5181b41922\") " pod="cert-manager/cert-manager-55b4d954d5-j2cvg" Sep 18 13:24:21.541800 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.541644 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmbb2\" (UniqueName: \"kubernetes.io/projected/c57f806c-237b-4f3c-bd4b-7c5181b41922-kube-api-access-gmbb2\") pod \"cert-manager-55b4d954d5-j2cvg\" (UID: \"c57f806c-237b-4f3c-bd4b-7c5181b41922\") " pod="cert-manager/cert-manager-55b4d954d5-j2cvg" Sep 18 13:24:21.633080 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.633042 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:21.643033 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.643011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c57f806c-237b-4f3c-bd4b-7c5181b41922-bound-sa-token\") pod \"cert-manager-55b4d954d5-j2cvg\" (UID: \"c57f806c-237b-4f3c-bd4b-7c5181b41922\") " pod="cert-manager/cert-manager-55b4d954d5-j2cvg" Sep 18 13:24:21.643138 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.643046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmbb2\" (UniqueName: \"kubernetes.io/projected/c57f806c-237b-4f3c-bd4b-7c5181b41922-kube-api-access-gmbb2\") pod \"cert-manager-55b4d954d5-j2cvg\" (UID: \"c57f806c-237b-4f3c-bd4b-7c5181b41922\") " pod="cert-manager/cert-manager-55b4d954d5-j2cvg" Sep 18 13:24:21.653228 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.653205 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmbb2\" (UniqueName: \"kubernetes.io/projected/c57f806c-237b-4f3c-bd4b-7c5181b41922-kube-api-access-gmbb2\") pod \"cert-manager-55b4d954d5-j2cvg\" (UID: \"c57f806c-237b-4f3c-bd4b-7c5181b41922\") " pod="cert-manager/cert-manager-55b4d954d5-j2cvg" Sep 18 13:24:21.654161 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.654141 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c57f806c-237b-4f3c-bd4b-7c5181b41922-bound-sa-token\") pod \"cert-manager-55b4d954d5-j2cvg\" (UID: \"c57f806c-237b-4f3c-bd4b-7c5181b41922\") " pod="cert-manager/cert-manager-55b4d954d5-j2cvg" Sep 18 13:24:21.733975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.733871 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:21.753839 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:21.753817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j2cvg" Sep 18 13:24:22.032599 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:22.032521 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j2cvg"] Sep 18 13:24:22.035450 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:24:22.035420 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc57f806c_237b_4f3c_bd4b_7c5181b41922.slice/crio-6c73e718042d2302cfed3224d3eb52353aba744df30fd463580e946a3de22d80 WatchSource:0}: Error finding container 6c73e718042d2302cfed3224d3eb52353aba744df30fd463580e946a3de22d80: Status 404 returned error can't find the container with id 6c73e718042d2302cfed3224d3eb52353aba744df30fd463580e946a3de22d80 Sep 18 13:24:22.037649 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:22.037633 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:24:22.056612 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:22.056584 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j2cvg" event={"ID":"c57f806c-237b-4f3c-bd4b-7c5181b41922","Type":"ContainerStarted","Data":"6c73e718042d2302cfed3224d3eb52353aba744df30fd463580e946a3de22d80"} Sep 18 13:24:26.076962 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:26.076928 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j2cvg" event={"ID":"c57f806c-237b-4f3c-bd4b-7c5181b41922","Type":"ContainerStarted","Data":"3ede9b6800d3195ee77a2757d03e9b20c4219442e21d656ff2f8dadedfbfe22e"} Sep 18 13:24:26.104960 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:26.104911 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-j2cvg" podStartSLOduration=1.748798777 podStartE2EDuration="5.104895619s" totalImagesPullingTime="3.356096842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:24:26.104468752 +0000 UTC m=+315.614107118" watchObservedRunningTime="2026-09-18 13:24:26.104895619 +0000 UTC m=+315.614533985" Sep 18 13:24:26.313809 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:26.313772 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:26.475207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:26.475110 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:36.754709 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:36.754675 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:38.022496 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:38.022465 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:39.450167 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:39.450120 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:39.566304 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:39.566273 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:47.148645 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:47.148607 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:48.132101 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:48.132062 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:48.237063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:48.237024 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:24:49.728386 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:24:49.728298 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:25:04.273765 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:04.273665 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:25:04.372868 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:04.372840 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:25:07.774269 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.774230 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:25:07.787829 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.787799 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx"] Sep 18 13:25:07.790939 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.790920 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:07.796420 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.796398 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 18 13:25:07.796420 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.796410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-hzsq7\"" Sep 18 13:25:07.796420 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.796426 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 13:25:07.796657 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.796455 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 18 13:25:07.796657 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.796502 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 13:25:07.802931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.802908 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx"] Sep 18 13:25:07.828465 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.828433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fa986cd-f546-4c6c-87c5-fd410cf20652-cert\") pod \"kubeflow-trainer-controller-manager-5df7849-qscgx\" (UID: \"2fa986cd-f546-4c6c-87c5-fd410cf20652\") " pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:07.828608 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.828491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/2fa986cd-f546-4c6c-87c5-fd410cf20652-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-5df7849-qscgx\" (UID: \"2fa986cd-f546-4c6c-87c5-fd410cf20652\") " pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:07.828608 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.828533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9jcc\" (UniqueName: \"kubernetes.io/projected/2fa986cd-f546-4c6c-87c5-fd410cf20652-kube-api-access-t9jcc\") pod \"kubeflow-trainer-controller-manager-5df7849-qscgx\" (UID: \"2fa986cd-f546-4c6c-87c5-fd410cf20652\") " pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:07.864965 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.864929 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:25:07.929310 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.929280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/2fa986cd-f546-4c6c-87c5-fd410cf20652-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-5df7849-qscgx\" (UID: \"2fa986cd-f546-4c6c-87c5-fd410cf20652\") " pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:07.929458 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.929324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9jcc\" (UniqueName: \"kubernetes.io/projected/2fa986cd-f546-4c6c-87c5-fd410cf20652-kube-api-access-t9jcc\") pod \"kubeflow-trainer-controller-manager-5df7849-qscgx\" (UID: \"2fa986cd-f546-4c6c-87c5-fd410cf20652\") " pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:07.929458 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.929371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fa986cd-f546-4c6c-87c5-fd410cf20652-cert\") pod \"kubeflow-trainer-controller-manager-5df7849-qscgx\" (UID: \"2fa986cd-f546-4c6c-87c5-fd410cf20652\") " pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:07.930046 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.930016 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/2fa986cd-f546-4c6c-87c5-fd410cf20652-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-5df7849-qscgx\" (UID: \"2fa986cd-f546-4c6c-87c5-fd410cf20652\") " pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:07.931875 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.931851 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fa986cd-f546-4c6c-87c5-fd410cf20652-cert\") pod \"kubeflow-trainer-controller-manager-5df7849-qscgx\" (UID: \"2fa986cd-f546-4c6c-87c5-fd410cf20652\") " pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:07.941110 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:07.941090 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9jcc\" (UniqueName: \"kubernetes.io/projected/2fa986cd-f546-4c6c-87c5-fd410cf20652-kube-api-access-t9jcc\") pod \"kubeflow-trainer-controller-manager-5df7849-qscgx\" (UID: \"2fa986cd-f546-4c6c-87c5-fd410cf20652\") " pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:08.102383 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:08.102349 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:08.384241 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:08.384218 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx"] Sep 18 13:25:08.385338 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:25:08.385315 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fa986cd_f546_4c6c_87c5_fd410cf20652.slice/crio-a993fc1d1a39dc50e81bb66779d4b017e9a11cac937ba365b20f4771aec179f3 WatchSource:0}: Error finding container a993fc1d1a39dc50e81bb66779d4b017e9a11cac937ba365b20f4771aec179f3: Status 404 returned error can't find the container with id a993fc1d1a39dc50e81bb66779d4b017e9a11cac937ba365b20f4771aec179f3 Sep 18 13:25:09.248831 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:09.248799 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" event={"ID":"2fa986cd-f546-4c6c-87c5-fd410cf20652","Type":"ContainerStarted","Data":"a993fc1d1a39dc50e81bb66779d4b017e9a11cac937ba365b20f4771aec179f3"} Sep 18 13:25:11.258074 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:11.258036 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" event={"ID":"2fa986cd-f546-4c6c-87c5-fd410cf20652","Type":"ContainerStarted","Data":"c5109607d52e3e4b6a429e5a756591fc449172c8d35f5189a94721b3a2ce0987"} Sep 18 13:25:11.258446 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:11.258101 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:11.276767 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:11.276704 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" podStartSLOduration=1.9425795620000001 podStartE2EDuration="4.276690174s" totalImagesPullingTime="2.334110612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:25:11.27579712 +0000 UTC m=+360.785435499" watchObservedRunningTime="2026-09-18 13:25:11.276690174 +0000 UTC m=+360.786328539" Sep 18 13:25:12.716829 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:12.716789 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:25:12.792062 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:12.792026 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:25:27.267819 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:27.267789 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-5df7849-qscgx" Sep 18 13:25:38.435152 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:38.435117 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:25:38.536433 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:25:38.536400 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:26:04.690078 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:04.690036 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:26:04.782805 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:04.782765 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:26:11.195884 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.195847 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:26:11.296642 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.296608 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:26:11.340669 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.340635 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-2vw7z/e2e-test-torch-node-0-0-lxz88"] Sep 18 13:26:11.343951 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.343934 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-2vw7z/e2e-test-torch-node-0-0-lxz88" Sep 18 13:26:11.346954 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.346914 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-2vw7z\"/\"openshift-service-ca.crt\"" Sep 18 13:26:11.346954 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.346926 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-2vw7z\"/\"default-dockercfg-mknkv\"" Sep 18 13:26:11.348199 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.348179 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-2vw7z\"/\"kube-root-ca.crt\"" Sep 18 13:26:11.355954 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.355935 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-2vw7z/e2e-test-torch-node-0-0-lxz88"] Sep 18 13:26:11.373267 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.373220 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:26:11.454015 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.453943 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjdrr\" (UniqueName: \"kubernetes.io/projected/0cd5fe51-7312-4817-8518-6c98718add68-kube-api-access-xjdrr\") pod \"e2e-test-torch-node-0-0-lxz88\" (UID: \"0cd5fe51-7312-4817-8518-6c98718add68\") " pod="e2e-2vw7z/e2e-test-torch-node-0-0-lxz88" Sep 18 13:26:11.554532 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.554494 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjdrr\" (UniqueName: \"kubernetes.io/projected/0cd5fe51-7312-4817-8518-6c98718add68-kube-api-access-xjdrr\") pod \"e2e-test-torch-node-0-0-lxz88\" (UID: \"0cd5fe51-7312-4817-8518-6c98718add68\") " pod="e2e-2vw7z/e2e-test-torch-node-0-0-lxz88" Sep 18 13:26:11.564910 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.564886 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjdrr\" (UniqueName: \"kubernetes.io/projected/0cd5fe51-7312-4817-8518-6c98718add68-kube-api-access-xjdrr\") pod \"e2e-test-torch-node-0-0-lxz88\" (UID: \"0cd5fe51-7312-4817-8518-6c98718add68\") " pod="e2e-2vw7z/e2e-test-torch-node-0-0-lxz88" Sep 18 13:26:11.653578 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.653556 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-2vw7z/e2e-test-torch-node-0-0-lxz88" Sep 18 13:26:11.926501 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:11.926479 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-2vw7z/e2e-test-torch-node-0-0-lxz88"] Sep 18 13:26:11.928944 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:26:11.928910 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cd5fe51_7312_4817_8518_6c98718add68.slice/crio-4ce52a3da63bb23eb7b81082e6207d517581b43cfed9a6bd5d4a810343a24472 WatchSource:0}: Error finding container 4ce52a3da63bb23eb7b81082e6207d517581b43cfed9a6bd5d4a810343a24472: Status 404 returned error can't find the container with id 4ce52a3da63bb23eb7b81082e6207d517581b43cfed9a6bd5d4a810343a24472 Sep 18 13:26:12.490606 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:12.490574 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-2vw7z/e2e-test-torch-node-0-0-lxz88" event={"ID":"0cd5fe51-7312-4817-8518-6c98718add68","Type":"ContainerStarted","Data":"4ce52a3da63bb23eb7b81082e6207d517581b43cfed9a6bd5d4a810343a24472"} Sep 18 13:26:15.349207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:15.349044 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:26:15.450537 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:15.450475 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:26:15.551001 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:26:15.550944 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:28:00.177832 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:28:00.177664 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:28:00.266374 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:28:00.266333 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:28:32.931193 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:28:32.931155 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:28:42.308610 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:28:42.308567 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:30:12.616407 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:30:12.616368 2580 log.go:32] "ListImages with filter from image service failed" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" filter="" Sep 18 13:30:12.616407 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:30:12.616410 2580 kuberuntime_image.go:108] "Failed to list images" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Sep 18 13:30:12.675774 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:12.616420 2580 image_gc_manager.go:230] "Failed to update image list" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Sep 18 13:30:23.237932 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:23.237901 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/1.log" Sep 18 13:30:23.238382 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:23.237910 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/1.log" Sep 18 13:30:24.705147 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:24.705121 2580 generic.go:356] "Generic (PLEG): container finished" podID="0cd5fe51-7312-4817-8518-6c98718add68" containerID="0e088c3884404858deccb7176103799bf84fdf88019c91c12f456ecffd42227a" exitCode=0 Sep 18 13:30:24.705438 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:24.705167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-2vw7z/e2e-test-torch-node-0-0-lxz88" event={"ID":"0cd5fe51-7312-4817-8518-6c98718add68","Type":"ContainerDied","Data":"0e088c3884404858deccb7176103799bf84fdf88019c91c12f456ecffd42227a"} Sep 18 13:30:25.844589 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:25.844566 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-2vw7z/e2e-test-torch-node-0-0-lxz88" Sep 18 13:30:26.015286 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:26.015210 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjdrr\" (UniqueName: \"kubernetes.io/projected/0cd5fe51-7312-4817-8518-6c98718add68-kube-api-access-xjdrr\") pod \"0cd5fe51-7312-4817-8518-6c98718add68\" (UID: \"0cd5fe51-7312-4817-8518-6c98718add68\") " Sep 18 13:30:26.017454 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:26.017433 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cd5fe51-7312-4817-8518-6c98718add68-kube-api-access-xjdrr" (OuterVolumeSpecName: "kube-api-access-xjdrr") pod "0cd5fe51-7312-4817-8518-6c98718add68" (UID: "0cd5fe51-7312-4817-8518-6c98718add68"). InnerVolumeSpecName "kube-api-access-xjdrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:30:26.115961 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:26.115928 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjdrr\" (UniqueName: \"kubernetes.io/projected/0cd5fe51-7312-4817-8518-6c98718add68-kube-api-access-xjdrr\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:30:26.714920 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:26.714890 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-2vw7z/e2e-test-torch-node-0-0-lxz88" Sep 18 13:30:26.714920 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:26.714915 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-2vw7z/e2e-test-torch-node-0-0-lxz88" event={"ID":"0cd5fe51-7312-4817-8518-6c98718add68","Type":"ContainerDied","Data":"4ce52a3da63bb23eb7b81082e6207d517581b43cfed9a6bd5d4a810343a24472"} Sep 18 13:30:26.715113 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:26.714949 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ce52a3da63bb23eb7b81082e6207d517581b43cfed9a6bd5d4a810343a24472" Sep 18 13:30:27.217365 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.217334 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:30:27.355911 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.355878 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk"] Sep 18 13:30:27.356231 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.356218 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cd5fe51-7312-4817-8518-6c98718add68" containerName="node" Sep 18 13:30:27.356231 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.356232 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cd5fe51-7312-4817-8518-6c98718add68" containerName="node" Sep 18 13:30:27.356311 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.356284 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cd5fe51-7312-4817-8518-6c98718add68" containerName="node" Sep 18 13:30:27.365001 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.364978 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk" Sep 18 13:30:27.368367 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.368347 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-8s7q6\"/\"default-dockercfg-lr76b\"" Sep 18 13:30:27.369580 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.369559 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-8s7q6\"/\"openshift-service-ca.crt\"" Sep 18 13:30:27.369913 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.369643 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-8s7q6\"/\"kube-root-ca.crt\"" Sep 18 13:30:27.370661 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.370641 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk"] Sep 18 13:30:27.526778 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.526694 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgx6x\" (UniqueName: \"kubernetes.io/projected/495a9eb3-8994-45cb-aefc-ede02647eb85-kube-api-access-wgx6x\") pod \"e2e-test-jax-node-0-0-5wfvk\" (UID: \"495a9eb3-8994-45cb-aefc-ede02647eb85\") " pod="e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk" Sep 18 13:30:27.627605 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.627576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgx6x\" (UniqueName: \"kubernetes.io/projected/495a9eb3-8994-45cb-aefc-ede02647eb85-kube-api-access-wgx6x\") pod \"e2e-test-jax-node-0-0-5wfvk\" (UID: \"495a9eb3-8994-45cb-aefc-ede02647eb85\") " pod="e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk" Sep 18 13:30:27.638173 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.638146 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgx6x\" (UniqueName: \"kubernetes.io/projected/495a9eb3-8994-45cb-aefc-ede02647eb85-kube-api-access-wgx6x\") pod \"e2e-test-jax-node-0-0-5wfvk\" (UID: \"495a9eb3-8994-45cb-aefc-ede02647eb85\") " pod="e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk" Sep 18 13:30:27.674957 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.674931 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk" Sep 18 13:30:27.960113 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.960079 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk"] Sep 18 13:30:27.963270 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:30:27.963248 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod495a9eb3_8994_45cb_aefc_ede02647eb85.slice/crio-d9b1c362b907834c6e8f20930dd7fc28674e16d57684c81d7094c7f616b01fb9 WatchSource:0}: Error finding container d9b1c362b907834c6e8f20930dd7fc28674e16d57684c81d7094c7f616b01fb9: Status 404 returned error can't find the container with id d9b1c362b907834c6e8f20930dd7fc28674e16d57684c81d7094c7f616b01fb9 Sep 18 13:30:27.965413 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:27.965395 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:30:28.545028 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:28.544985 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:30:28.725680 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:28.725649 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk" event={"ID":"495a9eb3-8994-45cb-aefc-ede02647eb85","Type":"ContainerStarted","Data":"d9b1c362b907834c6e8f20930dd7fc28674e16d57684c81d7094c7f616b01fb9"} Sep 18 13:30:32.140640 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:32.140582 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-2vw7z/e2e-test-torch-node-0-0-lxz88"] Sep 18 13:30:32.145907 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:32.145872 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-2vw7z/e2e-test-torch-node-0-0-lxz88"] Sep 18 13:30:32.398711 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:32.398593 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:30:32.626936 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:32.626906 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cd5fe51-7312-4817-8518-6c98718add68" path="/var/lib/kubelet/pods/0cd5fe51-7312-4817-8518-6c98718add68/volumes" Sep 18 13:30:33.050942 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:33.050886 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:30:33.191179 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:33.191143 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:30:33.426416 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:33.426338 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:30:33.489801 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:30:33.489769 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:31:11.134333 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:31:11.134207 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:31:11.204895 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:31:11.204857 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:31:13.639295 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:31:13.639241 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:31:13.741279 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:31:13.741229 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:31:50.057624 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:31:50.057570 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:32:01.396430 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:01.396388 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:32:51.419952 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:51.419921 2580 generic.go:356] "Generic (PLEG): container finished" podID="495a9eb3-8994-45cb-aefc-ede02647eb85" containerID="f6a652a5daeb9bb7b8e97b2a0e00b20dddefae4d8e2b4f40d59b64720928e835" exitCode=0 Sep 18 13:32:51.420317 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:51.420005 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk" event={"ID":"495a9eb3-8994-45cb-aefc-ede02647eb85","Type":"ContainerDied","Data":"f6a652a5daeb9bb7b8e97b2a0e00b20dddefae4d8e2b4f40d59b64720928e835"} Sep 18 13:32:52.566916 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:52.566887 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk" Sep 18 13:32:52.742748 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:52.742644 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgx6x\" (UniqueName: \"kubernetes.io/projected/495a9eb3-8994-45cb-aefc-ede02647eb85-kube-api-access-wgx6x\") pod \"495a9eb3-8994-45cb-aefc-ede02647eb85\" (UID: \"495a9eb3-8994-45cb-aefc-ede02647eb85\") " Sep 18 13:32:52.744939 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:52.744903 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495a9eb3-8994-45cb-aefc-ede02647eb85-kube-api-access-wgx6x" (OuterVolumeSpecName: "kube-api-access-wgx6x") pod "495a9eb3-8994-45cb-aefc-ede02647eb85" (UID: "495a9eb3-8994-45cb-aefc-ede02647eb85"). InnerVolumeSpecName "kube-api-access-wgx6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:32:52.843511 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:52.843487 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgx6x\" (UniqueName: \"kubernetes.io/projected/495a9eb3-8994-45cb-aefc-ede02647eb85-kube-api-access-wgx6x\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:32:53.429373 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:53.429344 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk" Sep 18 13:32:53.429373 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:53.429365 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk" event={"ID":"495a9eb3-8994-45cb-aefc-ede02647eb85","Type":"ContainerDied","Data":"d9b1c362b907834c6e8f20930dd7fc28674e16d57684c81d7094c7f616b01fb9"} Sep 18 13:32:53.429577 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:53.429398 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9b1c362b907834c6e8f20930dd7fc28674e16d57684c81d7094c7f616b01fb9" Sep 18 13:32:53.793190 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:53.793154 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:32:53.894148 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:53.894113 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:32:53.970039 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:53.970000 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:32:58.750036 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:58.749998 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk"] Sep 18 13:32:58.753414 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:58.753390 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-8s7q6/e2e-test-jax-node-0-0-5wfvk"] Sep 18 13:32:58.939671 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:58.939633 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:32:59.751230 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:59.751201 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:32:59.815115 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:32:59.815088 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:33:00.630700 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:00.630666 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="495a9eb3-8994-45cb-aefc-ede02647eb85" path="/var/lib/kubelet/pods/495a9eb3-8994-45cb-aefc-ede02647eb85/volumes" Sep 18 13:33:36.429901 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.429861 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:33:36.509696 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.509652 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:33:36.509927 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.509907 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-n2twt/e2e-test-flux-node-0-0-qzfnn"] Sep 18 13:33:36.510219 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.510208 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495a9eb3-8994-45cb-aefc-ede02647eb85" containerName="node" Sep 18 13:33:36.510264 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.510221 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="495a9eb3-8994-45cb-aefc-ede02647eb85" containerName="node" Sep 18 13:33:36.510305 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.510285 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="495a9eb3-8994-45cb-aefc-ede02647eb85" containerName="node" Sep 18 13:33:36.516387 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.516329 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.519326 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.519301 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-n2twt\"/\"e2e-test-flux-flux-curve\"" Sep 18 13:33:36.519326 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.519304 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-n2twt\"/\"e2e-test-flux-flux-entrypoint\"" Sep 18 13:33:36.519545 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.519485 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-n2twt\"/\"kube-root-ca.crt\"" Sep 18 13:33:36.520511 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.520494 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-n2twt\"/\"openshift-service-ca.crt\"" Sep 18 13:33:36.520615 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.520517 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-n2twt\"/\"default-dockercfg-txzcp\"" Sep 18 13:33:36.524368 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.524345 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-n2twt/e2e-test-flux-node-0-0-qzfnn"] Sep 18 13:33:36.583186 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.583152 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:33:36.619066 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.619039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/9add7378-b2ff-4355-8a6f-9e46dc1bf350-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.619253 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.619117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-install\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.619253 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.619145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-shared-memory\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.619253 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.619169 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hq9k\" (UniqueName: \"kubernetes.io/projected/9add7378-b2ff-4355-8a6f-9e46dc1bf350-kube-api-access-6hq9k\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.619253 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.619229 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-spack-install\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.619253 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.619251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-curve\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.720049 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.719951 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/9add7378-b2ff-4355-8a6f-9e46dc1bf350-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.720049 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.720018 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-install\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.720049 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.720046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-shared-memory\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.720351 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.720061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hq9k\" (UniqueName: \"kubernetes.io/projected/9add7378-b2ff-4355-8a6f-9e46dc1bf350-kube-api-access-6hq9k\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.720351 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.720087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-spack-install\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.720351 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.720107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-curve\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.720507 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.720453 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-install\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.720566 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.720529 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-spack-install\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.720903 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.720882 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/9add7378-b2ff-4355-8a6f-9e46dc1bf350-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.722397 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.722372 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-shared-memory\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.722492 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.722406 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-curve\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.728426 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.728407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hq9k\" (UniqueName: \"kubernetes.io/projected/9add7378-b2ff-4355-8a6f-9e46dc1bf350-kube-api-access-6hq9k\") pod \"e2e-test-flux-node-0-0-qzfnn\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:36.826597 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:36.826560 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:33:37.105296 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:37.105260 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-n2twt/e2e-test-flux-node-0-0-qzfnn"] Sep 18 13:33:37.109711 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:33:37.109680 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9add7378_b2ff_4355_8a6f_9e46dc1bf350.slice/crio-70b014ffcaf571cb391467ebb71f86232ab2c8d555516022bfdea5d252689263 WatchSource:0}: Error finding container 70b014ffcaf571cb391467ebb71f86232ab2c8d555516022bfdea5d252689263: Status 404 returned error can't find the container with id 70b014ffcaf571cb391467ebb71f86232ab2c8d555516022bfdea5d252689263 Sep 18 13:33:37.614561 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:37.614507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" event={"ID":"9add7378-b2ff-4355-8a6f-9e46dc1bf350","Type":"ContainerStarted","Data":"70b014ffcaf571cb391467ebb71f86232ab2c8d555516022bfdea5d252689263"} Sep 18 13:33:41.872028 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:41.871989 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:33:42.476220 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:42.476180 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:33:42.546466 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:42.546433 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:33:48.678102 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:48.678067 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" event={"ID":"9add7378-b2ff-4355-8a6f-9e46dc1bf350","Type":"ContainerStarted","Data":"b9aed33a43d026b7d3ab79ed8577ebb211a5ffdd588aecbb7f80961022a5b0f8"} Sep 18 13:33:51.698325 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:51.698294 2580 generic.go:356] "Generic (PLEG): container finished" podID="9add7378-b2ff-4355-8a6f-9e46dc1bf350" containerID="b9aed33a43d026b7d3ab79ed8577ebb211a5ffdd588aecbb7f80961022a5b0f8" exitCode=0 Sep 18 13:33:51.698729 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:51.698367 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" event={"ID":"9add7378-b2ff-4355-8a6f-9e46dc1bf350","Type":"ContainerDied","Data":"b9aed33a43d026b7d3ab79ed8577ebb211a5ffdd588aecbb7f80961022a5b0f8"} Sep 18 13:33:53.710439 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:53.710353 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" event={"ID":"9add7378-b2ff-4355-8a6f-9e46dc1bf350","Type":"ContainerStarted","Data":"bd7ecd4f7ad8b9af92d0db4e1e537ba515140e33a4c3351361c296d6a9787459"} Sep 18 13:33:53.735827 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:33:53.735770 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" podStartSLOduration=2.365599575 podStartE2EDuration="17.735754194s" totalImagesPullingTime="12.168477221s" totalInitContainerRuntime="3.201677398s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:33:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:33:53.73393999 +0000 UTC m=+883.243578357" watchObservedRunningTime="2026-09-18 13:33:53.735754194 +0000 UTC m=+883.245392563" Sep 18 13:34:03.760702 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:03.760615 2580 generic.go:356] "Generic (PLEG): container finished" podID="9add7378-b2ff-4355-8a6f-9e46dc1bf350" containerID="bd7ecd4f7ad8b9af92d0db4e1e537ba515140e33a4c3351361c296d6a9787459" exitCode=0 Sep 18 13:34:03.760702 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:03.760680 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" event={"ID":"9add7378-b2ff-4355-8a6f-9e46dc1bf350","Type":"ContainerDied","Data":"bd7ecd4f7ad8b9af92d0db4e1e537ba515140e33a4c3351361c296d6a9787459"} Sep 18 13:34:05.060158 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.060124 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:34:05.182964 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.182924 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-spack-install\") pod \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " Sep 18 13:34:05.183152 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.182984 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-curve\") pod \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " Sep 18 13:34:05.183152 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.183042 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-shared-memory\") pod \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " Sep 18 13:34:05.183152 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.183075 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-install\") pod \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " Sep 18 13:34:05.183323 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.183161 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/9add7378-b2ff-4355-8a6f-9e46dc1bf350-e2e-test-flux-flux-entrypoint\") pod \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " Sep 18 13:34:05.183323 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.183240 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hq9k\" (UniqueName: \"kubernetes.io/projected/9add7378-b2ff-4355-8a6f-9e46dc1bf350-kube-api-access-6hq9k\") pod \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\" (UID: \"9add7378-b2ff-4355-8a6f-9e46dc1bf350\") " Sep 18 13:34:05.183903 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.183857 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9add7378-b2ff-4355-8a6f-9e46dc1bf350-e2e-test-flux-flux-entrypoint" (OuterVolumeSpecName: "e2e-test-flux-flux-entrypoint") pod "9add7378-b2ff-4355-8a6f-9e46dc1bf350" (UID: "9add7378-b2ff-4355-8a6f-9e46dc1bf350"). InnerVolumeSpecName "e2e-test-flux-flux-entrypoint". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:34:05.186090 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.186060 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-curve" (OuterVolumeSpecName: "flux-curve") pod "9add7378-b2ff-4355-8a6f-9e46dc1bf350" (UID: "9add7378-b2ff-4355-8a6f-9e46dc1bf350"). InnerVolumeSpecName "flux-curve". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:34:05.186334 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.186307 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-shared-memory" (OuterVolumeSpecName: "shared-memory") pod "9add7378-b2ff-4355-8a6f-9e46dc1bf350" (UID: "9add7378-b2ff-4355-8a6f-9e46dc1bf350"). InnerVolumeSpecName "shared-memory". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:34:05.186599 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.186565 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9add7378-b2ff-4355-8a6f-9e46dc1bf350-kube-api-access-6hq9k" (OuterVolumeSpecName: "kube-api-access-6hq9k") pod "9add7378-b2ff-4355-8a6f-9e46dc1bf350" (UID: "9add7378-b2ff-4355-8a6f-9e46dc1bf350"). InnerVolumeSpecName "kube-api-access-6hq9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:34:05.284075 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.284031 2580 reconciler_common.go:299] "Volume detached for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-shared-memory\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:34:05.284075 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.284077 2580 reconciler_common.go:299] "Volume detached for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/9add7378-b2ff-4355-8a6f-9e46dc1bf350-e2e-test-flux-flux-entrypoint\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:34:05.284309 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.284094 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hq9k\" (UniqueName: \"kubernetes.io/projected/9add7378-b2ff-4355-8a6f-9e46dc1bf350-kube-api-access-6hq9k\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:34:05.284309 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.284109 2580 reconciler_common.go:299] "Volume detached for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-curve\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:34:05.508824 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.508703 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:05.602136 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.602096 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:05.747052 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.747014 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:05.774088 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.774012 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" event={"ID":"9add7378-b2ff-4355-8a6f-9e46dc1bf350","Type":"ContainerDied","Data":"70b014ffcaf571cb391467ebb71f86232ab2c8d555516022bfdea5d252689263"} Sep 18 13:34:05.774088 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.774043 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:34:05.774088 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:05.774058 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70b014ffcaf571cb391467ebb71f86232ab2c8d555516022bfdea5d252689263" Sep 18 13:34:06.616133 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:06.616095 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:06.714926 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:06.714896 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:07.006900 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:07.006811 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-install" (OuterVolumeSpecName: "flux-install") pod "9add7378-b2ff-4355-8a6f-9e46dc1bf350" (UID: "9add7378-b2ff-4355-8a6f-9e46dc1bf350"). InnerVolumeSpecName "flux-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:34:07.100614 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:07.100575 2580 reconciler_common.go:299] "Volume detached for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-flux-install\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:34:10.463038 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:10.463007 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-n2twt/e2e-test-flux-node-0-0-qzfnn"] Sep 18 13:34:10.465879 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:10.465854 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-n2twt/e2e-test-flux-node-0-0-qzfnn"] Sep 18 13:34:10.673453 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:10.673422 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:11.442670 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:11.442639 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:11.544093 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:11.544059 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:11.610278 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:11.610243 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:11.748154 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:11.748077 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:12.429050 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:12.429016 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:12.530801 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:12.530764 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:14.399156 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:14.399123 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-spack-install" (OuterVolumeSpecName: "spack-install") pod "9add7378-b2ff-4355-8a6f-9e46dc1bf350" (UID: "9add7378-b2ff-4355-8a6f-9e46dc1bf350"). InnerVolumeSpecName "spack-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:34:14.469705 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:14.469669 2580 reconciler_common.go:299] "Volume detached for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/9add7378-b2ff-4355-8a6f-9e46dc1bf350-spack-install\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:34:14.485395 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:34:14.485363 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-test-flux-node-0-0-qzfnn\" is forbidden: User \"system:node:ip-10-0-129-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"e2e-n2twt\": no relationship found between node 'ip-10-0-129-232.ec2.internal' and this object" podUID="9add7378-b2ff-4355-8a6f-9e46dc1bf350" pod="e2e-n2twt/e2e-test-flux-node-0-0-qzfnn" Sep 18 13:34:14.626141 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:14.626106 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9add7378-b2ff-4355-8a6f-9e46dc1bf350" path="/var/lib/kubelet/pods/9add7378-b2ff-4355-8a6f-9e46dc1bf350/volumes" Sep 18 13:34:21.657405 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:21.657355 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:21.766996 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:21.766958 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:27.192547 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:27.192514 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:27.291349 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:27.291313 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:31.094689 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.094654 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:31.199084 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.199046 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:31.233110 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.233076 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj"] Sep 18 13:34:31.233419 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.233405 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9add7378-b2ff-4355-8a6f-9e46dc1bf350" containerName="node" Sep 18 13:34:31.233476 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.233420 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9add7378-b2ff-4355-8a6f-9e46dc1bf350" containerName="node" Sep 18 13:34:31.233476 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.233441 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9add7378-b2ff-4355-8a6f-9e46dc1bf350" containerName="flux-installer" Sep 18 13:34:31.233476 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.233446 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9add7378-b2ff-4355-8a6f-9e46dc1bf350" containerName="flux-installer" Sep 18 13:34:31.233581 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.233503 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9add7378-b2ff-4355-8a6f-9e46dc1bf350" containerName="node" Sep 18 13:34:31.236469 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.236451 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" Sep 18 13:34:31.240280 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.240257 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-m86z6\"/\"kube-root-ca.crt\"" Sep 18 13:34:31.240405 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.240319 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-m86z6\"/\"default-dockercfg-66dbw\"" Sep 18 13:34:31.241477 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.241461 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-m86z6\"/\"openshift-service-ca.crt\"" Sep 18 13:34:31.248414 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.248394 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj"] Sep 18 13:34:31.297484 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.297422 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:31.311396 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.311369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r96w\" (UniqueName: \"kubernetes.io/projected/dd174dc0-4822-48ae-b4bd-69217228f656-kube-api-access-4r96w\") pod \"e2e-test-runtime-update-node-0-0-vjjrj\" (UID: \"dd174dc0-4822-48ae-b4bd-69217228f656\") " pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" Sep 18 13:34:31.412370 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.412272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r96w\" (UniqueName: \"kubernetes.io/projected/dd174dc0-4822-48ae-b4bd-69217228f656-kube-api-access-4r96w\") pod \"e2e-test-runtime-update-node-0-0-vjjrj\" (UID: \"dd174dc0-4822-48ae-b4bd-69217228f656\") " pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" Sep 18 13:34:31.421180 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.421154 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r96w\" (UniqueName: \"kubernetes.io/projected/dd174dc0-4822-48ae-b4bd-69217228f656-kube-api-access-4r96w\") pod \"e2e-test-runtime-update-node-0-0-vjjrj\" (UID: \"dd174dc0-4822-48ae-b4bd-69217228f656\") " pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" Sep 18 13:34:31.474559 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.474529 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj"] Sep 18 13:34:31.474859 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.474829 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" Sep 18 13:34:31.749206 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.749123 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj"] Sep 18 13:34:31.752754 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:34:31.752710 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd174dc0_4822_48ae_b4bd_69217228f656.slice/crio-615548fcdbd83c6e34235209ffb5b327caecc9bc8425eb6904d881d6de69f2e3 WatchSource:0}: Error finding container 615548fcdbd83c6e34235209ffb5b327caecc9bc8425eb6904d881d6de69f2e3: Status 404 returned error can't find the container with id 615548fcdbd83c6e34235209ffb5b327caecc9bc8425eb6904d881d6de69f2e3 Sep 18 13:34:31.897891 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:31.897859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" event={"ID":"dd174dc0-4822-48ae-b4bd-69217228f656","Type":"ContainerStarted","Data":"615548fcdbd83c6e34235209ffb5b327caecc9bc8425eb6904d881d6de69f2e3"} Sep 18 13:34:32.049398 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.049369 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:32.316672 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.316584 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:32.393460 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.393423 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:32.513167 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.513130 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:32.905120 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.905085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" event={"ID":"dd174dc0-4822-48ae-b4bd-69217228f656","Type":"ContainerStarted","Data":"1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b"} Sep 18 13:34:32.905313 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.905154 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" podUID="dd174dc0-4822-48ae-b4bd-69217228f656" containerName="node" containerID="cri-o://1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b" gracePeriod=30 Sep 18 13:34:32.923027 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.922981 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" podStartSLOduration=1.5855380399999999 podStartE2EDuration="1.922963976s" totalImagesPullingTime="337.425936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:34:32.92157051 +0000 UTC m=+922.431208878" watchObservedRunningTime="2026-09-18 13:34:32.922963976 +0000 UTC m=+922.432602342" Sep 18 13:34:32.951127 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.951091 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6"] Sep 18 13:34:32.954318 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.954303 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" Sep 18 13:34:32.957499 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.957479 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-hdddf\"/\"kube-root-ca.crt\"" Sep 18 13:34:32.957499 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.957496 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-hdddf\"/\"openshift-service-ca.crt\"" Sep 18 13:34:32.957659 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.957485 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-hdddf\"/\"default-dockercfg-lp5pm\"" Sep 18 13:34:32.962943 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:32.962915 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6"] Sep 18 13:34:33.023331 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.023307 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrrp\" (UniqueName: \"kubernetes.io/projected/1224fb14-379d-4021-8a12-ff35b89089be-kube-api-access-sxrrp\") pod \"e2e-test-runtime-update-node-0-0-blrz6\" (UID: \"1224fb14-379d-4021-8a12-ff35b89089be\") " pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" Sep 18 13:34:33.123799 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.123768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrrp\" (UniqueName: \"kubernetes.io/projected/1224fb14-379d-4021-8a12-ff35b89089be-kube-api-access-sxrrp\") pod \"e2e-test-runtime-update-node-0-0-blrz6\" (UID: \"1224fb14-379d-4021-8a12-ff35b89089be\") " pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" Sep 18 13:34:33.134403 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.134275 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrrp\" (UniqueName: \"kubernetes.io/projected/1224fb14-379d-4021-8a12-ff35b89089be-kube-api-access-sxrrp\") pod \"e2e-test-runtime-update-node-0-0-blrz6\" (UID: \"1224fb14-379d-4021-8a12-ff35b89089be\") " pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" Sep 18 13:34:33.155558 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.155491 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" Sep 18 13:34:33.181995 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.181962 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6"] Sep 18 13:34:33.182254 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.182239 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" Sep 18 13:34:33.202096 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.202049 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:33.224935 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.224902 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r96w\" (UniqueName: \"kubernetes.io/projected/dd174dc0-4822-48ae-b4bd-69217228f656-kube-api-access-4r96w\") pod \"dd174dc0-4822-48ae-b4bd-69217228f656\" (UID: \"dd174dc0-4822-48ae-b4bd-69217228f656\") " Sep 18 13:34:33.227151 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.227124 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd174dc0-4822-48ae-b4bd-69217228f656-kube-api-access-4r96w" (OuterVolumeSpecName: "kube-api-access-4r96w") pod "dd174dc0-4822-48ae-b4bd-69217228f656" (UID: "dd174dc0-4822-48ae-b4bd-69217228f656"). InnerVolumeSpecName "kube-api-access-4r96w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:34:33.326467 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.326425 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r96w\" (UniqueName: \"kubernetes.io/projected/dd174dc0-4822-48ae-b4bd-69217228f656-kube-api-access-4r96w\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:34:33.451645 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.451607 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:33.452069 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.452049 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6"] Sep 18 13:34:33.454072 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:34:33.454046 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1224fb14_379d_4021_8a12_ff35b89089be.slice/crio-3d85ef0a6e57210b85c8792c66f18d18ea4a9b30bff8f13cbd92f954899080ee WatchSource:0}: Error finding container 3d85ef0a6e57210b85c8792c66f18d18ea4a9b30bff8f13cbd92f954899080ee: Status 404 returned error can't find the container with id 3d85ef0a6e57210b85c8792c66f18d18ea4a9b30bff8f13cbd92f954899080ee Sep 18 13:34:33.563119 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.563083 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:33.682011 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.681980 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26"] Sep 18 13:34:33.682324 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.682312 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd174dc0-4822-48ae-b4bd-69217228f656" containerName="node" Sep 18 13:34:33.682367 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.682326 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd174dc0-4822-48ae-b4bd-69217228f656" containerName="node" Sep 18 13:34:33.682402 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.682397 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd174dc0-4822-48ae-b4bd-69217228f656" containerName="node" Sep 18 13:34:33.685342 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.685326 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" Sep 18 13:34:33.688218 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.688193 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-68r6s\"/\"kube-root-ca.crt\"" Sep 18 13:34:33.688348 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.688193 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-68r6s\"/\"openshift-service-ca.crt\"" Sep 18 13:34:33.688348 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.688293 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-68r6s\"/\"default-dockercfg-rxn2r\"" Sep 18 13:34:33.697332 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.697309 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26"] Sep 18 13:34:33.710666 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.710601 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:33.730078 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.730056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97g8c\" (UniqueName: \"kubernetes.io/projected/aff11cd7-9d09-46e5-8e32-4494a82653bc-kube-api-access-97g8c\") pod \"progression-enabled-node-0-0-zdn26\" (UID: \"aff11cd7-9d09-46e5-8e32-4494a82653bc\") " pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" Sep 18 13:34:33.830938 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.830899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97g8c\" (UniqueName: \"kubernetes.io/projected/aff11cd7-9d09-46e5-8e32-4494a82653bc-kube-api-access-97g8c\") pod \"progression-enabled-node-0-0-zdn26\" (UID: \"aff11cd7-9d09-46e5-8e32-4494a82653bc\") " pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" Sep 18 13:34:33.840542 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.840513 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97g8c\" (UniqueName: \"kubernetes.io/projected/aff11cd7-9d09-46e5-8e32-4494a82653bc-kube-api-access-97g8c\") pod \"progression-enabled-node-0-0-zdn26\" (UID: \"aff11cd7-9d09-46e5-8e32-4494a82653bc\") " pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" Sep 18 13:34:33.911812 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.911773 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" event={"ID":"1224fb14-379d-4021-8a12-ff35b89089be","Type":"ContainerStarted","Data":"8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188"} Sep 18 13:34:33.912014 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.911830 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" event={"ID":"1224fb14-379d-4021-8a12-ff35b89089be","Type":"ContainerStarted","Data":"3d85ef0a6e57210b85c8792c66f18d18ea4a9b30bff8f13cbd92f954899080ee"} Sep 18 13:34:33.912014 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.911825 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" podUID="1224fb14-379d-4021-8a12-ff35b89089be" containerName="node" containerID="cri-o://8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188" gracePeriod=30 Sep 18 13:34:33.913228 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.913203 2580 generic.go:356] "Generic (PLEG): container finished" podID="dd174dc0-4822-48ae-b4bd-69217228f656" containerID="1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b" exitCode=0 Sep 18 13:34:33.913358 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.913236 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" Sep 18 13:34:33.913358 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.913270 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" event={"ID":"dd174dc0-4822-48ae-b4bd-69217228f656","Type":"ContainerDied","Data":"1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b"} Sep 18 13:34:33.913358 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.913303 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj" event={"ID":"dd174dc0-4822-48ae-b4bd-69217228f656","Type":"ContainerDied","Data":"615548fcdbd83c6e34235209ffb5b327caecc9bc8425eb6904d881d6de69f2e3"} Sep 18 13:34:33.913358 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.913326 2580 scope.go:117] "RemoveContainer" containerID="1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b" Sep 18 13:34:33.929759 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.929701 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" podStartSLOduration=1.9296860329999999 podStartE2EDuration="1.929686033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:34:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:34:33.927728084 +0000 UTC m=+923.437366450" watchObservedRunningTime="2026-09-18 13:34:33.929686033 +0000 UTC m=+923.439324398" Sep 18 13:34:33.965319 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.965295 2580 scope.go:117] "RemoveContainer" containerID="1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b" Sep 18 13:34:33.965692 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:34:33.965673 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b\": container with ID starting with 1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b not found: ID does not exist" containerID="1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b" Sep 18 13:34:33.965763 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.965701 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b"} err="failed to get container status \"1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b\": rpc error: code = NotFound desc = could not find container \"1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b\": container with ID starting with 1e4ca96d6b4ca05df5a552dc07503b5c72ee91a9a7cf13b0ff943e4c1101393b not found: ID does not exist" Sep 18 13:34:33.976662 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.976639 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj"] Sep 18 13:34:33.982998 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.982973 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-m86z6/e2e-test-runtime-update-node-0-0-vjjrj"] Sep 18 13:34:33.995503 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:33.995480 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" Sep 18 13:34:34.167594 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.167571 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" Sep 18 13:34:34.234169 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.234089 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxrrp\" (UniqueName: \"kubernetes.io/projected/1224fb14-379d-4021-8a12-ff35b89089be-kube-api-access-sxrrp\") pod \"1224fb14-379d-4021-8a12-ff35b89089be\" (UID: \"1224fb14-379d-4021-8a12-ff35b89089be\") " Sep 18 13:34:34.236253 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.236224 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1224fb14-379d-4021-8a12-ff35b89089be-kube-api-access-sxrrp" (OuterVolumeSpecName: "kube-api-access-sxrrp") pod "1224fb14-379d-4021-8a12-ff35b89089be" (UID: "1224fb14-379d-4021-8a12-ff35b89089be"). InnerVolumeSpecName "kube-api-access-sxrrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:34:34.269254 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.269201 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26"] Sep 18 13:34:34.271880 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:34:34.271852 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff11cd7_9d09_46e5_8e32_4494a82653bc.slice/crio-de812d623b99e1d8fe5b3ca6ea26a6cad4dd2e8484f20d42f5a79fd2bd69eb10 WatchSource:0}: Error finding container de812d623b99e1d8fe5b3ca6ea26a6cad4dd2e8484f20d42f5a79fd2bd69eb10: Status 404 returned error can't find the container with id de812d623b99e1d8fe5b3ca6ea26a6cad4dd2e8484f20d42f5a79fd2bd69eb10 Sep 18 13:34:34.335289 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.335257 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxrrp\" (UniqueName: \"kubernetes.io/projected/1224fb14-379d-4021-8a12-ff35b89089be-kube-api-access-sxrrp\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:34:34.624620 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.624592 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd174dc0-4822-48ae-b4bd-69217228f656" path="/var/lib/kubelet/pods/dd174dc0-4822-48ae-b4bd-69217228f656/volumes" Sep 18 13:34:34.923194 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.922571 2580 generic.go:356] "Generic (PLEG): container finished" podID="1224fb14-379d-4021-8a12-ff35b89089be" containerID="8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188" exitCode=0 Sep 18 13:34:34.923194 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.922652 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" event={"ID":"1224fb14-379d-4021-8a12-ff35b89089be","Type":"ContainerDied","Data":"8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188"} Sep 18 13:34:34.923194 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.922687 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" event={"ID":"1224fb14-379d-4021-8a12-ff35b89089be","Type":"ContainerDied","Data":"3d85ef0a6e57210b85c8792c66f18d18ea4a9b30bff8f13cbd92f954899080ee"} Sep 18 13:34:34.923194 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.922711 2580 scope.go:117] "RemoveContainer" containerID="8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188" Sep 18 13:34:34.923194 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.922816 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6" Sep 18 13:34:34.925903 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.925144 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" event={"ID":"aff11cd7-9d09-46e5-8e32-4494a82653bc","Type":"ContainerStarted","Data":"de812d623b99e1d8fe5b3ca6ea26a6cad4dd2e8484f20d42f5a79fd2bd69eb10"} Sep 18 13:34:34.937600 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.937510 2580 scope.go:117] "RemoveContainer" containerID="8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188" Sep 18 13:34:34.939859 ip-10-0-129-232 kubenswrapper[2580]: E0918 13:34:34.939549 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188\": container with ID starting with 8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188 not found: ID does not exist" containerID="8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188" Sep 18 13:34:34.939859 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.939586 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188"} err="failed to get container status \"8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188\": rpc error: code = NotFound desc = could not find container \"8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188\": container with ID starting with 8eac5c0e7b76dd9a80a597374eb91372ff47c9489d2edb101ee46167a1231188 not found: ID does not exist" Sep 18 13:34:34.943480 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.943421 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6"] Sep 18 13:34:34.947407 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:34.947386 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-hdddf/e2e-test-runtime-update-node-0-0-blrz6"] Sep 18 13:34:36.179974 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:36.179937 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:36.628144 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:36.628109 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1224fb14-379d-4021-8a12-ff35b89089be" path="/var/lib/kubelet/pods/1224fb14-379d-4021-8a12-ff35b89089be/volumes" Sep 18 13:34:36.745992 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:36.745918 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:36.809708 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:36.809638 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:37.927779 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:37.927589 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:37.984207 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:37.984169 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:38.961440 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:38.961378 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:34:39.063111 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:34:39.063038 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:35:02.263304 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:02.263265 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:35:04.345571 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:04.345527 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:35:14.387168 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:14.387130 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:35:28.923227 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:28.923197 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/1.log" Sep 18 13:35:28.923741 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:28.923244 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/1.log" Sep 18 13:35:31.264930 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:31.264835 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" event={"ID":"aff11cd7-9d09-46e5-8e32-4494a82653bc","Type":"ContainerStarted","Data":"f0d01c5f4a17a50d4d6f6b1cecf9c7082c41c4941d9030b11132c038c082a42f"} Sep 18 13:35:31.285872 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:31.285821 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" podStartSLOduration=1.700825099 podStartE2EDuration="58.285804771s" totalImagesPullingTime="56.584979672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:35:31.283165796 +0000 UTC m=+980.792804174" watchObservedRunningTime="2026-09-18 13:35:31.285804771 +0000 UTC m=+980.795443183" Sep 18 13:35:53.365184 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:53.365152 2580 generic.go:356] "Generic (PLEG): container finished" podID="aff11cd7-9d09-46e5-8e32-4494a82653bc" containerID="f0d01c5f4a17a50d4d6f6b1cecf9c7082c41c4941d9030b11132c038c082a42f" exitCode=0 Sep 18 13:35:53.365607 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:53.365210 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" event={"ID":"aff11cd7-9d09-46e5-8e32-4494a82653bc","Type":"ContainerDied","Data":"f0d01c5f4a17a50d4d6f6b1cecf9c7082c41c4941d9030b11132c038c082a42f"} Sep 18 13:35:54.517065 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:54.517036 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" Sep 18 13:35:54.589635 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:54.589603 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97g8c\" (UniqueName: \"kubernetes.io/projected/aff11cd7-9d09-46e5-8e32-4494a82653bc-kube-api-access-97g8c\") pod \"aff11cd7-9d09-46e5-8e32-4494a82653bc\" (UID: \"aff11cd7-9d09-46e5-8e32-4494a82653bc\") " Sep 18 13:35:54.591844 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:54.591813 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff11cd7-9d09-46e5-8e32-4494a82653bc-kube-api-access-97g8c" (OuterVolumeSpecName: "kube-api-access-97g8c") pod "aff11cd7-9d09-46e5-8e32-4494a82653bc" (UID: "aff11cd7-9d09-46e5-8e32-4494a82653bc"). InnerVolumeSpecName "kube-api-access-97g8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:35:54.690732 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:54.690683 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97g8c\" (UniqueName: \"kubernetes.io/projected/aff11cd7-9d09-46e5-8e32-4494a82653bc-kube-api-access-97g8c\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:35:55.375790 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.375757 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" Sep 18 13:35:55.375790 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.375770 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26" event={"ID":"aff11cd7-9d09-46e5-8e32-4494a82653bc","Type":"ContainerDied","Data":"de812d623b99e1d8fe5b3ca6ea26a6cad4dd2e8484f20d42f5a79fd2bd69eb10"} Sep 18 13:35:55.376010 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.375828 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de812d623b99e1d8fe5b3ca6ea26a6cad4dd2e8484f20d42f5a79fd2bd69eb10" Sep 18 13:35:55.908339 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.908301 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t"] Sep 18 13:35:55.908931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.908631 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff11cd7-9d09-46e5-8e32-4494a82653bc" containerName="node" Sep 18 13:35:55.908931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.908647 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff11cd7-9d09-46e5-8e32-4494a82653bc" containerName="node" Sep 18 13:35:55.908931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.908664 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1224fb14-379d-4021-8a12-ff35b89089be" containerName="node" Sep 18 13:35:55.908931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.908669 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1224fb14-379d-4021-8a12-ff35b89089be" containerName="node" Sep 18 13:35:55.908931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.908741 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1224fb14-379d-4021-8a12-ff35b89089be" containerName="node" Sep 18 13:35:55.908931 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.908751 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff11cd7-9d09-46e5-8e32-4494a82653bc" containerName="node" Sep 18 13:35:55.916274 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.916251 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:35:55.927675 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.927653 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" Sep 18 13:35:55.932090 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.932064 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-68r6s\"/\"kube-root-ca.crt\"" Sep 18 13:35:55.932651 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.932633 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-68r6s\"/\"openshift-service-ca.crt\"" Sep 18 13:35:55.932842 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.932813 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-68r6s\"/\"default-dockercfg-rxn2r\"" Sep 18 13:35:55.933526 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:55.933356 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t"] Sep 18 13:35:56.002704 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:56.002669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ld5t\" (UniqueName: \"kubernetes.io/projected/54c67aae-372b-44c1-9c5c-2ba4e6f72884-kube-api-access-5ld5t\") pod \"progression-disabled-node-0-0-ssz2t\" (UID: \"54c67aae-372b-44c1-9c5c-2ba4e6f72884\") " pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" Sep 18 13:35:56.104024 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:56.103982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ld5t\" (UniqueName: \"kubernetes.io/projected/54c67aae-372b-44c1-9c5c-2ba4e6f72884-kube-api-access-5ld5t\") pod \"progression-disabled-node-0-0-ssz2t\" (UID: \"54c67aae-372b-44c1-9c5c-2ba4e6f72884\") " pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" Sep 18 13:35:56.113173 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:56.113139 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ld5t\" (UniqueName: \"kubernetes.io/projected/54c67aae-372b-44c1-9c5c-2ba4e6f72884-kube-api-access-5ld5t\") pod \"progression-disabled-node-0-0-ssz2t\" (UID: \"54c67aae-372b-44c1-9c5c-2ba4e6f72884\") " pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" Sep 18 13:35:56.238379 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:56.238288 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" Sep 18 13:35:56.526455 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:56.526429 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t"] Sep 18 13:35:56.528597 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:35:56.528566 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c67aae_372b_44c1_9c5c_2ba4e6f72884.slice/crio-45ebfe5af52dff75a4f82c146d9eca6e31c2ca30047380d8b2d6703e3594346f WatchSource:0}: Error finding container 45ebfe5af52dff75a4f82c146d9eca6e31c2ca30047380d8b2d6703e3594346f: Status 404 returned error can't find the container with id 45ebfe5af52dff75a4f82c146d9eca6e31c2ca30047380d8b2d6703e3594346f Sep 18 13:35:57.391703 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:57.391668 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" event={"ID":"54c67aae-372b-44c1-9c5c-2ba4e6f72884","Type":"ContainerStarted","Data":"0eebc482207304a7b943de6ea8ccb2316fd87467f6b5a60b1213c1b5c7bee80b"} Sep 18 13:35:57.392183 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:57.391763 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" event={"ID":"54c67aae-372b-44c1-9c5c-2ba4e6f72884","Type":"ContainerStarted","Data":"45ebfe5af52dff75a4f82c146d9eca6e31c2ca30047380d8b2d6703e3594346f"} Sep 18 13:35:57.409966 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:35:57.409918 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" podStartSLOduration=2.40990263 podStartE2EDuration="2.40990263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:35:57.409191252 +0000 UTC m=+1006.918829616" watchObservedRunningTime="2026-09-18 13:35:57.40990263 +0000 UTC m=+1006.919541007" Sep 18 13:36:18.491127 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:18.491088 2580 generic.go:356] "Generic (PLEG): container finished" podID="54c67aae-372b-44c1-9c5c-2ba4e6f72884" containerID="0eebc482207304a7b943de6ea8ccb2316fd87467f6b5a60b1213c1b5c7bee80b" exitCode=0 Sep 18 13:36:18.491573 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:18.491160 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" event={"ID":"54c67aae-372b-44c1-9c5c-2ba4e6f72884","Type":"ContainerDied","Data":"0eebc482207304a7b943de6ea8ccb2316fd87467f6b5a60b1213c1b5c7bee80b"} Sep 18 13:36:19.623173 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:19.623149 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" Sep 18 13:36:19.711705 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:19.711666 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ld5t\" (UniqueName: \"kubernetes.io/projected/54c67aae-372b-44c1-9c5c-2ba4e6f72884-kube-api-access-5ld5t\") pod \"54c67aae-372b-44c1-9c5c-2ba4e6f72884\" (UID: \"54c67aae-372b-44c1-9c5c-2ba4e6f72884\") " Sep 18 13:36:19.713828 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:19.713798 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c67aae-372b-44c1-9c5c-2ba4e6f72884-kube-api-access-5ld5t" (OuterVolumeSpecName: "kube-api-access-5ld5t") pod "54c67aae-372b-44c1-9c5c-2ba4e6f72884" (UID: "54c67aae-372b-44c1-9c5c-2ba4e6f72884"). InnerVolumeSpecName "kube-api-access-5ld5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:36:19.813293 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:19.813262 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ld5t\" (UniqueName: \"kubernetes.io/projected/54c67aae-372b-44c1-9c5c-2ba4e6f72884-kube-api-access-5ld5t\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:36:20.502682 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:20.502652 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" Sep 18 13:36:20.502682 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:20.502675 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t" event={"ID":"54c67aae-372b-44c1-9c5c-2ba4e6f72884","Type":"ContainerDied","Data":"45ebfe5af52dff75a4f82c146d9eca6e31c2ca30047380d8b2d6703e3594346f"} Sep 18 13:36:20.502911 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:20.502732 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45ebfe5af52dff75a4f82c146d9eca6e31c2ca30047380d8b2d6703e3594346f" Sep 18 13:36:28.907140 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:28.907108 2580 scope.go:117] "RemoveContainer" containerID="0e088c3884404858deccb7176103799bf84fdf88019c91c12f456ecffd42227a" Sep 18 13:36:30.988004 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:30.987965 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827"] Sep 18 13:36:30.988511 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:30.988490 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c67aae-372b-44c1-9c5c-2ba4e6f72884" containerName="node" Sep 18 13:36:30.988588 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:30.988515 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c67aae-372b-44c1-9c5c-2ba4e6f72884" containerName="node" Sep 18 13:36:30.988643 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:30.988628 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c67aae-372b-44c1-9c5c-2ba4e6f72884" containerName="node" Sep 18 13:36:30.989472 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:30.989440 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:36:30.990623 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:30.990608 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" Sep 18 13:36:30.993634 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:30.993612 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-68r6s\"/\"kube-root-ca.crt\"" Sep 18 13:36:30.994106 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:30.994088 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-68r6s\"/\"openshift-service-ca.crt\"" Sep 18 13:36:30.994200 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:30.994116 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-68r6s\"/\"default-dockercfg-rxn2r\"" Sep 18 13:36:31.011257 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:31.011218 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827"] Sep 18 13:36:31.114031 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:31.113985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krkjv\" (UniqueName: \"kubernetes.io/projected/1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca-kube-api-access-krkjv\") pod \"progression-invalid-node-0-0-bc827\" (UID: \"1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca\") " pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" Sep 18 13:36:31.215043 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:31.215002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krkjv\" (UniqueName: \"kubernetes.io/projected/1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca-kube-api-access-krkjv\") pod \"progression-invalid-node-0-0-bc827\" (UID: \"1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca\") " pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" Sep 18 13:36:31.224260 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:31.224228 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krkjv\" (UniqueName: \"kubernetes.io/projected/1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca-kube-api-access-krkjv\") pod \"progression-invalid-node-0-0-bc827\" (UID: \"1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca\") " pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" Sep 18 13:36:31.299925 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:31.299894 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" Sep 18 13:36:31.567318 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:31.567292 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827"] Sep 18 13:36:31.569161 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:36:31.569127 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fca3f5f_7e9c_4b6a_8d03_f9a5e5e7c3ca.slice/crio-9535ab10004d39d212365ece015ee0fb11581cb5e1353c1580283e209cf5f4ea WatchSource:0}: Error finding container 9535ab10004d39d212365ece015ee0fb11581cb5e1353c1580283e209cf5f4ea: Status 404 returned error can't find the container with id 9535ab10004d39d212365ece015ee0fb11581cb5e1353c1580283e209cf5f4ea Sep 18 13:36:32.557404 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:32.557371 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" event={"ID":"1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca","Type":"ContainerStarted","Data":"6683d84b8ddc549259c4eff88a64e65932e78b5d33571c68f214b8756c5420d4"} Sep 18 13:36:32.557830 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:32.557427 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" event={"ID":"1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca","Type":"ContainerStarted","Data":"9535ab10004d39d212365ece015ee0fb11581cb5e1353c1580283e209cf5f4ea"} Sep 18 13:36:32.578490 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:32.578439 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" podStartSLOduration=2.57842393 podStartE2EDuration="2.57842393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:36:32.576587714 +0000 UTC m=+1042.086226082" watchObservedRunningTime="2026-09-18 13:36:32.57842393 +0000 UTC m=+1042.088062295" Sep 18 13:36:46.010087 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:46.010044 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz"] Sep 18 13:36:46.012623 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:46.012600 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" Sep 18 13:36:46.016894 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:46.016853 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:36:46.030700 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:46.030664 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz"] Sep 18 13:36:46.045765 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:46.045734 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxchx\" (UniqueName: \"kubernetes.io/projected/de90b1f4-bf52-4cf4-89fe-016219cdf169-kube-api-access-lxchx\") pod \"progression-custom-config-node-0-0-l8ffz\" (UID: \"de90b1f4-bf52-4cf4-89fe-016219cdf169\") " pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" Sep 18 13:36:46.146302 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:46.146257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxchx\" (UniqueName: \"kubernetes.io/projected/de90b1f4-bf52-4cf4-89fe-016219cdf169-kube-api-access-lxchx\") pod \"progression-custom-config-node-0-0-l8ffz\" (UID: \"de90b1f4-bf52-4cf4-89fe-016219cdf169\") " pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" Sep 18 13:36:46.155583 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:46.155545 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxchx\" (UniqueName: \"kubernetes.io/projected/de90b1f4-bf52-4cf4-89fe-016219cdf169-kube-api-access-lxchx\") pod \"progression-custom-config-node-0-0-l8ffz\" (UID: \"de90b1f4-bf52-4cf4-89fe-016219cdf169\") " pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" Sep 18 13:36:46.321493 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:46.321465 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" Sep 18 13:36:46.595468 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:46.595408 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz"] Sep 18 13:36:46.597559 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:36:46.597532 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde90b1f4_bf52_4cf4_89fe_016219cdf169.slice/crio-0625a09b4ab5951ecd767dc2176f8a21030c1db4e3004a379f00e80ffb2282ea WatchSource:0}: Error finding container 0625a09b4ab5951ecd767dc2176f8a21030c1db4e3004a379f00e80ffb2282ea: Status 404 returned error can't find the container with id 0625a09b4ab5951ecd767dc2176f8a21030c1db4e3004a379f00e80ffb2282ea Sep 18 13:36:46.624250 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:46.624220 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" event={"ID":"de90b1f4-bf52-4cf4-89fe-016219cdf169","Type":"ContainerStarted","Data":"0625a09b4ab5951ecd767dc2176f8a21030c1db4e3004a379f00e80ffb2282ea"} Sep 18 13:36:47.625983 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:47.625950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" event={"ID":"de90b1f4-bf52-4cf4-89fe-016219cdf169","Type":"ContainerStarted","Data":"3fe3b610c0526a1568fb80421116a13a033665a216d6dbb3d91c47056da371b9"} Sep 18 13:36:47.645336 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:47.645286 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" podStartSLOduration=2.6452719030000003 podStartE2EDuration="2.645271903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:36:47.642745601 +0000 UTC m=+1057.152383961" watchObservedRunningTime="2026-09-18 13:36:47.645271903 +0000 UTC m=+1057.154910280" Sep 18 13:36:50.046814 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:50.046782 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr"] Sep 18 13:36:50.049075 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:50.049054 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" Sep 18 13:36:50.063603 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:50.063576 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr"] Sep 18 13:36:50.069133 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:50.069111 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:36:50.079362 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:50.079335 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7fm5\" (UniqueName: \"kubernetes.io/projected/6066ce03-6ed4-4844-8526-ecbd79abbb57-kube-api-access-d7fm5\") pod \"progression-min-interval-node-0-0-j75hr\" (UID: \"6066ce03-6ed4-4844-8526-ecbd79abbb57\") " pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" Sep 18 13:36:50.179781 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:50.179747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7fm5\" (UniqueName: \"kubernetes.io/projected/6066ce03-6ed4-4844-8526-ecbd79abbb57-kube-api-access-d7fm5\") pod \"progression-min-interval-node-0-0-j75hr\" (UID: \"6066ce03-6ed4-4844-8526-ecbd79abbb57\") " pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" Sep 18 13:36:50.189612 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:50.189578 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7fm5\" (UniqueName: \"kubernetes.io/projected/6066ce03-6ed4-4844-8526-ecbd79abbb57-kube-api-access-d7fm5\") pod \"progression-min-interval-node-0-0-j75hr\" (UID: \"6066ce03-6ed4-4844-8526-ecbd79abbb57\") " pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" Sep 18 13:36:50.364255 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:50.364180 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" Sep 18 13:36:50.439188 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:50.439158 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:36:50.639168 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:50.639136 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr"] Sep 18 13:36:50.641053 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:36:50.641018 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6066ce03_6ed4_4844_8526_ecbd79abbb57.slice/crio-c5f4a85c9522accc51bd3f81662a74525e9b282340135d430f78494a6bce11c3 WatchSource:0}: Error finding container c5f4a85c9522accc51bd3f81662a74525e9b282340135d430f78494a6bce11c3: Status 404 returned error can't find the container with id c5f4a85c9522accc51bd3f81662a74525e9b282340135d430f78494a6bce11c3 Sep 18 13:36:51.647948 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:51.647908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" event={"ID":"6066ce03-6ed4-4844-8526-ecbd79abbb57","Type":"ContainerStarted","Data":"918354f3067a1d40f38bad0a33e90887a3590c27a2beb99b873d38547662b55c"} Sep 18 13:36:51.648309 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:51.647966 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" event={"ID":"6066ce03-6ed4-4844-8526-ecbd79abbb57","Type":"ContainerStarted","Data":"c5f4a85c9522accc51bd3f81662a74525e9b282340135d430f78494a6bce11c3"} Sep 18 13:36:51.670142 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:51.670093 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" podStartSLOduration=1.6700789390000002 podStartE2EDuration="1.670078939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:36:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:36:51.667757609 +0000 UTC m=+1061.177395979" watchObservedRunningTime="2026-09-18 13:36:51.670078939 +0000 UTC m=+1061.179717304" Sep 18 13:36:53.658063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:53.658028 2580 generic.go:356] "Generic (PLEG): container finished" podID="1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca" containerID="6683d84b8ddc549259c4eff88a64e65932e78b5d33571c68f214b8756c5420d4" exitCode=0 Sep 18 13:36:53.658063 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:53.658063 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" event={"ID":"1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca","Type":"ContainerDied","Data":"6683d84b8ddc549259c4eff88a64e65932e78b5d33571c68f214b8756c5420d4"} Sep 18 13:36:54.788588 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:54.788564 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" Sep 18 13:36:54.818016 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:54.817985 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krkjv\" (UniqueName: \"kubernetes.io/projected/1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca-kube-api-access-krkjv\") pod \"1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca\" (UID: \"1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca\") " Sep 18 13:36:54.820296 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:54.820264 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca-kube-api-access-krkjv" (OuterVolumeSpecName: "kube-api-access-krkjv") pod "1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca" (UID: "1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca"). InnerVolumeSpecName "kube-api-access-krkjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:36:54.919668 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:54.919600 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krkjv\" (UniqueName: \"kubernetes.io/projected/1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca-kube-api-access-krkjv\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:36:55.668109 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:55.668074 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" event={"ID":"1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca","Type":"ContainerDied","Data":"9535ab10004d39d212365ece015ee0fb11581cb5e1353c1580283e209cf5f4ea"} Sep 18 13:36:55.668109 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:55.668097 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827" Sep 18 13:36:55.668319 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:36:55.668119 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9535ab10004d39d212365ece015ee0fb11581cb5e1353c1580283e209cf5f4ea" Sep 18 13:37:08.726337 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:08.726303 2580 generic.go:356] "Generic (PLEG): container finished" podID="de90b1f4-bf52-4cf4-89fe-016219cdf169" containerID="3fe3b610c0526a1568fb80421116a13a033665a216d6dbb3d91c47056da371b9" exitCode=0 Sep 18 13:37:08.726756 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:08.726343 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" event={"ID":"de90b1f4-bf52-4cf4-89fe-016219cdf169","Type":"ContainerDied","Data":"3fe3b610c0526a1568fb80421116a13a033665a216d6dbb3d91c47056da371b9"} Sep 18 13:37:09.856869 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:09.856846 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" Sep 18 13:37:09.941290 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:09.941259 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxchx\" (UniqueName: \"kubernetes.io/projected/de90b1f4-bf52-4cf4-89fe-016219cdf169-kube-api-access-lxchx\") pod \"de90b1f4-bf52-4cf4-89fe-016219cdf169\" (UID: \"de90b1f4-bf52-4cf4-89fe-016219cdf169\") " Sep 18 13:37:09.943114 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:09.943092 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de90b1f4-bf52-4cf4-89fe-016219cdf169-kube-api-access-lxchx" (OuterVolumeSpecName: "kube-api-access-lxchx") pod "de90b1f4-bf52-4cf4-89fe-016219cdf169" (UID: "de90b1f4-bf52-4cf4-89fe-016219cdf169"). InnerVolumeSpecName "kube-api-access-lxchx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:37:10.042582 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:10.042558 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxchx\" (UniqueName: \"kubernetes.io/projected/de90b1f4-bf52-4cf4-89fe-016219cdf169-kube-api-access-lxchx\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:37:10.742112 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:10.742078 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" event={"ID":"de90b1f4-bf52-4cf4-89fe-016219cdf169","Type":"ContainerDied","Data":"0625a09b4ab5951ecd767dc2176f8a21030c1db4e3004a379f00e80ffb2282ea"} Sep 18 13:37:10.742264 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:10.742125 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz" Sep 18 13:37:10.742264 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:10.742146 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0625a09b4ab5951ecd767dc2176f8a21030c1db4e3004a379f00e80ffb2282ea" Sep 18 13:37:12.753540 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:12.753508 2580 generic.go:356] "Generic (PLEG): container finished" podID="6066ce03-6ed4-4844-8526-ecbd79abbb57" containerID="918354f3067a1d40f38bad0a33e90887a3590c27a2beb99b873d38547662b55c" exitCode=0 Sep 18 13:37:12.753897 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:12.753579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" event={"ID":"6066ce03-6ed4-4844-8526-ecbd79abbb57","Type":"ContainerDied","Data":"918354f3067a1d40f38bad0a33e90887a3590c27a2beb99b873d38547662b55c"} Sep 18 13:37:13.880852 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:13.880833 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" Sep 18 13:37:13.975956 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:13.975928 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7fm5\" (UniqueName: \"kubernetes.io/projected/6066ce03-6ed4-4844-8526-ecbd79abbb57-kube-api-access-d7fm5\") pod \"6066ce03-6ed4-4844-8526-ecbd79abbb57\" (UID: \"6066ce03-6ed4-4844-8526-ecbd79abbb57\") " Sep 18 13:37:13.977951 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:13.977927 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6066ce03-6ed4-4844-8526-ecbd79abbb57-kube-api-access-d7fm5" (OuterVolumeSpecName: "kube-api-access-d7fm5") pod "6066ce03-6ed4-4844-8526-ecbd79abbb57" (UID: "6066ce03-6ed4-4844-8526-ecbd79abbb57"). InnerVolumeSpecName "kube-api-access-d7fm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:37:14.077416 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:14.077392 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7fm5\" (UniqueName: \"kubernetes.io/projected/6066ce03-6ed4-4844-8526-ecbd79abbb57-kube-api-access-d7fm5\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:37:14.765816 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:14.765733 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" Sep 18 13:37:14.765816 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:14.765738 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr" event={"ID":"6066ce03-6ed4-4844-8526-ecbd79abbb57","Type":"ContainerDied","Data":"c5f4a85c9522accc51bd3f81662a74525e9b282340135d430f78494a6bce11c3"} Sep 18 13:37:14.765816 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:37:14.765778 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5f4a85c9522accc51bd3f81662a74525e9b282340135d430f78494a6bce11c3" Sep 18 13:38:04.454263 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.454225 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x"] Sep 18 13:38:04.454887 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.454681 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca" containerName="node" Sep 18 13:38:04.454887 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.454699 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca" containerName="node" Sep 18 13:38:04.454887 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.454712 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de90b1f4-bf52-4cf4-89fe-016219cdf169" containerName="node" Sep 18 13:38:04.454887 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.454740 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="de90b1f4-bf52-4cf4-89fe-016219cdf169" containerName="node" Sep 18 13:38:04.454887 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.454782 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6066ce03-6ed4-4844-8526-ecbd79abbb57" containerName="node" Sep 18 13:38:04.454887 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.454791 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6066ce03-6ed4-4844-8526-ecbd79abbb57" containerName="node" Sep 18 13:38:04.454887 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.454883 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca" containerName="node" Sep 18 13:38:04.455247 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.454897 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6066ce03-6ed4-4844-8526-ecbd79abbb57" containerName="node" Sep 18 13:38:04.455247 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.454909 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="de90b1f4-bf52-4cf4-89fe-016219cdf169" containerName="node" Sep 18 13:38:04.456913 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.456892 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" Sep 18 13:38:04.459805 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.459787 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-68r6s\"/\"openshift-service-ca.crt\"" Sep 18 13:38:04.459928 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.459908 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-68r6s\"/\"kube-root-ca.crt\"" Sep 18 13:38:04.460890 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.460875 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-68r6s\"/\"default-dockercfg-rxn2r\"" Sep 18 13:38:04.467097 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.467077 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x"] Sep 18 13:38:04.470040 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.470010 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:38:04.578540 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.578506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjm6l\" (UniqueName: \"kubernetes.io/projected/a49c9cc5-4c53-4e69-9959-5accb39dc88f-kube-api-access-gjm6l\") pod \"progression-no-metrics-node-0-0-cst5x\" (UID: \"a49c9cc5-4c53-4e69-9959-5accb39dc88f\") " pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" Sep 18 13:38:04.679079 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.679050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjm6l\" (UniqueName: \"kubernetes.io/projected/a49c9cc5-4c53-4e69-9959-5accb39dc88f-kube-api-access-gjm6l\") pod \"progression-no-metrics-node-0-0-cst5x\" (UID: \"a49c9cc5-4c53-4e69-9959-5accb39dc88f\") " pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" Sep 18 13:38:04.688771 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.688749 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjm6l\" (UniqueName: \"kubernetes.io/projected/a49c9cc5-4c53-4e69-9959-5accb39dc88f-kube-api-access-gjm6l\") pod \"progression-no-metrics-node-0-0-cst5x\" (UID: \"a49c9cc5-4c53-4e69-9959-5accb39dc88f\") " pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" Sep 18 13:38:04.766307 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:04.766241 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" Sep 18 13:38:05.041747 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:05.036803 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x"] Sep 18 13:38:05.996216 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:05.996186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" event={"ID":"a49c9cc5-4c53-4e69-9959-5accb39dc88f","Type":"ContainerStarted","Data":"e09cf5865671575378bca040d4b302f839877e960b0c9754fb9178eda571a153"} Sep 18 13:38:05.996587 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:05.996230 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" event={"ID":"a49c9cc5-4c53-4e69-9959-5accb39dc88f","Type":"ContainerStarted","Data":"7636763924fc05c96d10dda46b2cacfc962eaf05ad0b16fe277d895951320b64"} Sep 18 13:38:06.018539 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:06.018496 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" podStartSLOduration=2.018481198 podStartE2EDuration="2.018481198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:38:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:38:06.016043737 +0000 UTC m=+1135.525682103" watchObservedRunningTime="2026-09-18 13:38:06.018481198 +0000 UTC m=+1135.528119563" Sep 18 13:38:11.019639 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:11.019607 2580 generic.go:356] "Generic (PLEG): container finished" podID="a49c9cc5-4c53-4e69-9959-5accb39dc88f" containerID="e09cf5865671575378bca040d4b302f839877e960b0c9754fb9178eda571a153" exitCode=0 Sep 18 13:38:11.020127 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:11.019683 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" event={"ID":"a49c9cc5-4c53-4e69-9959-5accb39dc88f","Type":"ContainerDied","Data":"e09cf5865671575378bca040d4b302f839877e960b0c9754fb9178eda571a153"} Sep 18 13:38:12.155799 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:12.155776 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" Sep 18 13:38:12.240164 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:12.240138 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjm6l\" (UniqueName: \"kubernetes.io/projected/a49c9cc5-4c53-4e69-9959-5accb39dc88f-kube-api-access-gjm6l\") pod \"a49c9cc5-4c53-4e69-9959-5accb39dc88f\" (UID: \"a49c9cc5-4c53-4e69-9959-5accb39dc88f\") " Sep 18 13:38:12.242134 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:12.242110 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49c9cc5-4c53-4e69-9959-5accb39dc88f-kube-api-access-gjm6l" (OuterVolumeSpecName: "kube-api-access-gjm6l") pod "a49c9cc5-4c53-4e69-9959-5accb39dc88f" (UID: "a49c9cc5-4c53-4e69-9959-5accb39dc88f"). InnerVolumeSpecName "kube-api-access-gjm6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:38:12.341055 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:12.341025 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjm6l\" (UniqueName: \"kubernetes.io/projected/a49c9cc5-4c53-4e69-9959-5accb39dc88f-kube-api-access-gjm6l\") on node \"ip-10-0-129-232.ec2.internal\" DevicePath \"\"" Sep 18 13:38:13.033045 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:13.032969 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" Sep 18 13:38:13.033045 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:13.033004 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x" event={"ID":"a49c9cc5-4c53-4e69-9959-5accb39dc88f","Type":"ContainerDied","Data":"7636763924fc05c96d10dda46b2cacfc962eaf05ad0b16fe277d895951320b64"} Sep 18 13:38:13.033045 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:13.033044 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7636763924fc05c96d10dda46b2cacfc962eaf05ad0b16fe277d895951320b64" Sep 18 13:38:14.551686 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:14.551655 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:38:15.476531 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:15.476494 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:38:15.575984 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:15.575951 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:38:19.530595 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.530557 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz"] Sep 18 13:38:19.534535 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.534510 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-68r6s/progression-custom-config-node-0-0-l8ffz"] Sep 18 13:38:19.542205 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.542185 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t"] Sep 18 13:38:19.549290 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.549267 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-68r6s/progression-disabled-node-0-0-ssz2t"] Sep 18 13:38:19.554675 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.554653 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26"] Sep 18 13:38:19.558886 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.558858 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-68r6s/progression-enabled-node-0-0-zdn26"] Sep 18 13:38:19.566664 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.566643 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827"] Sep 18 13:38:19.571255 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.571235 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-68r6s/progression-invalid-node-0-0-bc827"] Sep 18 13:38:19.594241 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.594196 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr"] Sep 18 13:38:19.596730 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.596699 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-68r6s/progression-min-interval-node-0-0-j75hr"] Sep 18 13:38:19.602264 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.602245 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x"] Sep 18 13:38:19.607922 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.607902 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-68r6s/progression-no-metrics-node-0-0-cst5x"] Sep 18 13:38:19.830534 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.830503 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:38:19.904094 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:19.904066 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:38:20.575298 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:20.575260 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:38:20.625643 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:20.625616 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca" path="/var/lib/kubelet/pods/1fca3f5f-7e9c-4b6a-8d03-f9a5e5e7c3ca/volumes" Sep 18 13:38:20.625975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:20.625961 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c67aae-372b-44c1-9c5c-2ba4e6f72884" path="/var/lib/kubelet/pods/54c67aae-372b-44c1-9c5c-2ba4e6f72884/volumes" Sep 18 13:38:20.626245 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:20.626234 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6066ce03-6ed4-4844-8526-ecbd79abbb57" path="/var/lib/kubelet/pods/6066ce03-6ed4-4844-8526-ecbd79abbb57/volumes" Sep 18 13:38:20.626509 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:20.626498 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a49c9cc5-4c53-4e69-9959-5accb39dc88f" path="/var/lib/kubelet/pods/a49c9cc5-4c53-4e69-9959-5accb39dc88f/volumes" Sep 18 13:38:20.626806 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:20.626793 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff11cd7-9d09-46e5-8e32-4494a82653bc" path="/var/lib/kubelet/pods/aff11cd7-9d09-46e5-8e32-4494a82653bc/volumes" Sep 18 13:38:20.627086 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:20.627075 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de90b1f4-bf52-4cf4-89fe-016219cdf169" path="/var/lib/kubelet/pods/de90b1f4-bf52-4cf4-89fe-016219cdf169/volumes" Sep 18 13:38:20.634421 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:20.634398 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:38:27.012215 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:27.012091 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:38:27.112027 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:38:27.111996 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:39:13.289254 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.289218 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:39:13.441910 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.441879 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4r6kb/must-gather-pmhs4"] Sep 18 13:39:13.442232 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.442220 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49c9cc5-4c53-4e69-9959-5accb39dc88f" containerName="node" Sep 18 13:39:13.442276 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.442234 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49c9cc5-4c53-4e69-9959-5accb39dc88f" containerName="node" Sep 18 13:39:13.442313 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.442302 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a49c9cc5-4c53-4e69-9959-5accb39dc88f" containerName="node" Sep 18 13:39:13.444520 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.444499 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4r6kb/must-gather-pmhs4" Sep 18 13:39:13.447432 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.447403 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4r6kb\"/\"kube-root-ca.crt\"" Sep 18 13:39:13.447551 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.447495 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4r6kb\"/\"openshift-service-ca.crt\"" Sep 18 13:39:13.448743 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.448704 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4r6kb\"/\"default-dockercfg-lrptv\"" Sep 18 13:39:13.457052 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.457034 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4r6kb/must-gather-pmhs4"] Sep 18 13:39:13.461318 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.461293 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:39:13.545470 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.545448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a7de7429-85c6-4868-aa19-4922dd5f0a1e-must-gather-output\") pod \"must-gather-pmhs4\" (UID: \"a7de7429-85c6-4868-aa19-4922dd5f0a1e\") " pod="openshift-must-gather-4r6kb/must-gather-pmhs4" Sep 18 13:39:13.545586 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.545506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84m7n\" (UniqueName: \"kubernetes.io/projected/a7de7429-85c6-4868-aa19-4922dd5f0a1e-kube-api-access-84m7n\") pod \"must-gather-pmhs4\" (UID: \"a7de7429-85c6-4868-aa19-4922dd5f0a1e\") " pod="openshift-must-gather-4r6kb/must-gather-pmhs4" Sep 18 13:39:13.562286 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.562259 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:39:13.646766 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.646736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a7de7429-85c6-4868-aa19-4922dd5f0a1e-must-gather-output\") pod \"must-gather-pmhs4\" (UID: \"a7de7429-85c6-4868-aa19-4922dd5f0a1e\") " pod="openshift-must-gather-4r6kb/must-gather-pmhs4" Sep 18 13:39:13.646892 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.646804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84m7n\" (UniqueName: \"kubernetes.io/projected/a7de7429-85c6-4868-aa19-4922dd5f0a1e-kube-api-access-84m7n\") pod \"must-gather-pmhs4\" (UID: \"a7de7429-85c6-4868-aa19-4922dd5f0a1e\") " pod="openshift-must-gather-4r6kb/must-gather-pmhs4" Sep 18 13:39:13.647100 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.647079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a7de7429-85c6-4868-aa19-4922dd5f0a1e-must-gather-output\") pod \"must-gather-pmhs4\" (UID: \"a7de7429-85c6-4868-aa19-4922dd5f0a1e\") " pod="openshift-must-gather-4r6kb/must-gather-pmhs4" Sep 18 13:39:13.658167 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.658149 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84m7n\" (UniqueName: \"kubernetes.io/projected/a7de7429-85c6-4868-aa19-4922dd5f0a1e-kube-api-access-84m7n\") pod \"must-gather-pmhs4\" (UID: \"a7de7429-85c6-4868-aa19-4922dd5f0a1e\") " pod="openshift-must-gather-4r6kb/must-gather-pmhs4" Sep 18 13:39:13.753000 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:13.752968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4r6kb/must-gather-pmhs4" Sep 18 13:39:14.021305 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:14.021141 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4r6kb/must-gather-pmhs4"] Sep 18 13:39:14.023548 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:39:14.023522 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7de7429_85c6_4868_aa19_4922dd5f0a1e.slice/crio-f4b2f5d79061b61a27047b6f50727a6f719f080d713803f0015873ededc83b52 WatchSource:0}: Error finding container f4b2f5d79061b61a27047b6f50727a6f719f080d713803f0015873ededc83b52: Status 404 returned error can't find the container with id f4b2f5d79061b61a27047b6f50727a6f719f080d713803f0015873ededc83b52 Sep 18 13:39:14.025844 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:14.025822 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:39:14.326774 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:14.326745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r6kb/must-gather-pmhs4" event={"ID":"a7de7429-85c6-4868-aa19-4922dd5f0a1e","Type":"ContainerStarted","Data":"f4b2f5d79061b61a27047b6f50727a6f719f080d713803f0015873ededc83b52"} Sep 18 13:39:15.334478 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:15.334438 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r6kb/must-gather-pmhs4" event={"ID":"a7de7429-85c6-4868-aa19-4922dd5f0a1e","Type":"ContainerStarted","Data":"11a87092960059c2363d6690c2d8f9e542f510f2931e328511d7b650d8c15a06"} Sep 18 13:39:15.334478 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:15.334485 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r6kb/must-gather-pmhs4" event={"ID":"a7de7429-85c6-4868-aa19-4922dd5f0a1e","Type":"ContainerStarted","Data":"76ca1f05ef349a59b786febc329fb00b7fd0557dda74d49da31671d7a53851e7"} Sep 18 13:39:15.353014 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:15.352955 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4r6kb/must-gather-pmhs4" podStartSLOduration=1.68059711 podStartE2EDuration="2.352934285s" totalImagesPullingTime="672.337175ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:39:15.351245398 +0000 UTC m=+1204.860883774" watchObservedRunningTime="2026-09-18 13:39:15.352934285 +0000 UTC m=+1204.862572650" Sep 18 13:39:16.400895 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:16.400862 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zjkgw_0361a153-89d1-45d7-a84f-a3fcd4368a2c/global-pull-secret-syncer/0.log" Sep 18 13:39:16.449518 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:16.449486 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" Sep 18 13:39:16.534034 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:16.533982 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-232.ec2.internal_66735a565a3af6f436b6c35ffc205408/haproxy/0.log" Sep 18 13:39:19.019734 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:19.019693 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:39:19.104429 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:19.104345 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-br5x2_8e696015-7fc3-4280-852c-9929002e2dbf/konnectivity-agent/0.log" limit=1024 Sep 18 13:39:20.053765 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.053738 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_faf1f3f4-f273-4909-9955-192d911d148b/alertmanager/0.log" Sep 18 13:39:20.090956 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.090929 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_faf1f3f4-f273-4909-9955-192d911d148b/config-reloader/0.log" Sep 18 13:39:20.113527 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.113503 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_faf1f3f4-f273-4909-9955-192d911d148b/kube-rbac-proxy-web/0.log" Sep 18 13:39:20.142184 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.141892 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_faf1f3f4-f273-4909-9955-192d911d148b/kube-rbac-proxy/0.log" Sep 18 13:39:20.168190 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.168115 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_faf1f3f4-f273-4909-9955-192d911d148b/kube-rbac-proxy-metric/0.log" Sep 18 13:39:20.196298 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.196260 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_faf1f3f4-f273-4909-9955-192d911d148b/prom-label-proxy/0.log" Sep 18 13:39:20.225968 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.225935 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_faf1f3f4-f273-4909-9955-192d911d148b/init-config-reloader/0.log" Sep 18 13:39:20.264156 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.264121 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-4x8h9_bffe10e1-e15b-4f40-9e6d-f49e2b3a908c/cluster-monitoring-operator/0.log" Sep 18 13:39:20.300222 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.300190 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-d7k5c_a5658efc-42d1-425a-8bc8-c73b7e8e44b4/kube-state-metrics/0.log" Sep 18 13:39:20.326338 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.326259 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-d7k5c_a5658efc-42d1-425a-8bc8-c73b7e8e44b4/kube-rbac-proxy-main/0.log" Sep 18 13:39:20.356494 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.356461 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-d7k5c_a5658efc-42d1-425a-8bc8-c73b7e8e44b4/kube-rbac-proxy-self/0.log" Sep 18 13:39:20.437968 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.437937 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-2t452_2e0624f2-a25c-4d9a-a9cd-afb50e587bec/monitoring-plugin/0.log" Sep 18 13:39:20.472410 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.472377 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wwnk_8f5c8d69-6617-4e5a-aa2c-f27c8415619a/node-exporter/0.log" Sep 18 13:39:20.499435 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.499405 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wwnk_8f5c8d69-6617-4e5a-aa2c-f27c8415619a/kube-rbac-proxy/0.log" Sep 18 13:39:20.527184 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.527152 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wwnk_8f5c8d69-6617-4e5a-aa2c-f27c8415619a/init-textfile/0.log" Sep 18 13:39:20.820123 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.820097 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d061626f-8b92-4c07-b4de-615905c7accd/prometheus/0.log" Sep 18 13:39:20.849340 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.849310 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d061626f-8b92-4c07-b4de-615905c7accd/config-reloader/0.log" Sep 18 13:39:20.875227 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.875150 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d061626f-8b92-4c07-b4de-615905c7accd/thanos-sidecar/0.log" Sep 18 13:39:20.913687 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.913647 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d061626f-8b92-4c07-b4de-615905c7accd/kube-rbac-proxy-web/0.log" Sep 18 13:39:20.944638 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.944605 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d061626f-8b92-4c07-b4de-615905c7accd/kube-rbac-proxy/0.log" Sep 18 13:39:20.972243 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:20.972214 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d061626f-8b92-4c07-b4de-615905c7accd/kube-rbac-proxy-thanos/0.log" Sep 18 13:39:21.000917 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:21.000886 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d061626f-8b92-4c07-b4de-615905c7accd/init-config-reloader/0.log" Sep 18 13:39:21.100584 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:21.100550 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-xq6lx_1f9cd9e3-fddb-4d42-bd50-6f9cc3bd6e4f/prometheus-operator-admission-webhook/0.log" Sep 18 13:39:21.140463 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:21.140386 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86c656b4c8-wkb8r_dfc18c1f-898c-42b2-9667-8affb59cda6d/telemeter-client/0.log" Sep 18 13:39:21.164256 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:21.164223 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86c656b4c8-wkb8r_dfc18c1f-898c-42b2-9667-8affb59cda6d/reload/0.log" Sep 18 13:39:21.186678 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:21.186646 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86c656b4c8-wkb8r_dfc18c1f-898c-42b2-9667-8affb59cda6d/kube-rbac-proxy/0.log" Sep 18 13:39:23.246297 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.246196 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/1.log" Sep 18 13:39:23.256935 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.256908 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lqdbs_adbcbf9d-62a6-415c-ab54-6066c4bcc6c3/console-operator/2.log" Sep 18 13:39:23.624277 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.624243 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk"] Sep 18 13:39:23.629979 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.629949 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.637518 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.637493 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk"] Sep 18 13:39:23.753233 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.753162 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7sqf\" (UniqueName: \"kubernetes.io/projected/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-kube-api-access-z7sqf\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.753506 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.753482 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-sys\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.753667 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.753651 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-podres\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.753866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.753848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-lib-modules\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.753975 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.753885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-proc\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.854625 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.854587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-lib-modules\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.854625 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.854627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-proc\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.854899 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.854656 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7sqf\" (UniqueName: \"kubernetes.io/projected/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-kube-api-access-z7sqf\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.854899 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.854678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-sys\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.854899 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.854729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-podres\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.854899 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.854752 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-proc\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.854899 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.854789 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-sys\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.854899 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.854795 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-lib-modules\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.854899 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.854886 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-podres\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.862925 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.862899 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7sqf\" (UniqueName: \"kubernetes.io/projected/b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630-kube-api-access-z7sqf\") pod \"perf-node-gather-daemonset-27xkk\" (UID: \"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630\") " pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:23.943575 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:23.943491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:24.232347 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:24.232171 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk"] Sep 18 13:39:24.235238 ip-10-0-129-232 kubenswrapper[2580]: W0918 13:39:24.235197 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb0ac1ca1_4261_4e3b_87ce_7bd0e6ebe630.slice/crio-492329a3f3a7fd5ab212e77e34e6c7ef6379fc6072cf89071dceb856b1e70fa0 WatchSource:0}: Error finding container 492329a3f3a7fd5ab212e77e34e6c7ef6379fc6072cf89071dceb856b1e70fa0: Status 404 returned error can't find the container with id 492329a3f3a7fd5ab212e77e34e6c7ef6379fc6072cf89071dceb856b1e70fa0 Sep 18 13:39:24.393099 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:24.393065 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" event={"ID":"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630","Type":"ContainerStarted","Data":"ed1f9f2718d227798d1119b05db6afc3354f83f1956ccc424d20258a7e9dffca"} Sep 18 13:39:24.393514 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:24.393118 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" event={"ID":"b0ac1ca1-4261-4e3b-87ce-7bd0e6ebe630","Type":"ContainerStarted","Data":"492329a3f3a7fd5ab212e77e34e6c7ef6379fc6072cf89071dceb856b1e70fa0"} Sep 18 13:39:24.393514 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:24.393163 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:25.054989 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:25.054932 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q5s2h_211a7909-2eed-45a3-b415-7fdb59b6de1e/dns/0.log" Sep 18 13:39:25.074833 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:25.074805 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q5s2h_211a7909-2eed-45a3-b415-7fdb59b6de1e/kube-rbac-proxy/0.log" Sep 18 13:39:25.170515 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:25.170483 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c9xcg_380ff550-0e7a-46ea-a947-9fff416d9181/dns-node-resolver/0.log" Sep 18 13:39:25.622801 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:25.622761 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tz7qx_322730aa-4fe2-413f-9df6-8249b41758ee/node-ca/0.log" Sep 18 13:39:26.754541 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:26.754506 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tvqnd_dbab27f6-d66f-44e0-9a48-556495083572/serve-healthcheck-canary/0.log" Sep 18 13:39:27.142327 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:27.142295 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5s72c_4fe7de31-923d-4db0-8d99-83907bac08c0/kube-rbac-proxy/0.log" Sep 18 13:39:27.163283 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:27.163257 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5s72c_4fe7de31-923d-4db0-8d99-83907bac08c0/exporter/0.log" Sep 18 13:39:27.184391 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:27.184362 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5s72c_4fe7de31-923d-4db0-8d99-83907bac08c0/extractor/0.log" Sep 18 13:39:28.943195 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:28.943163 2580 scope.go:117] "RemoveContainer" containerID="f6a652a5daeb9bb7b8e97b2a0e00b20dddefae4d8e2b4f40d59b64720928e835" Sep 18 13:39:30.414105 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:30.414076 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" Sep 18 13:39:30.435617 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:30.435571 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4r6kb/perf-node-gather-daemonset-27xkk" podStartSLOduration=7.435556084 podStartE2EDuration="7.435556084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:39:24.410876741 +0000 UTC m=+1213.920515106" watchObservedRunningTime="2026-09-18 13:39:30.435556084 +0000 UTC m=+1219.945194449" Sep 18 13:39:33.649227 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:33.649194 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxnd_1090a9ee-3fad-4085-b97f-bae07eef0fc3/kube-multus-additional-cni-plugins/0.log" Sep 18 13:39:33.672866 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:33.672842 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxnd_1090a9ee-3fad-4085-b97f-bae07eef0fc3/egress-router-binary-copy/0.log" Sep 18 13:39:33.742418 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:33.742384 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxnd_1090a9ee-3fad-4085-b97f-bae07eef0fc3/cni-plugins/0.log" Sep 18 13:39:33.761850 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:33.761822 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxnd_1090a9ee-3fad-4085-b97f-bae07eef0fc3/bond-cni-plugin/0.log" Sep 18 13:39:33.801173 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:33.801145 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxnd_1090a9ee-3fad-4085-b97f-bae07eef0fc3/routeoverride-cni/0.log" Sep 18 13:39:33.818659 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:33.818635 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxnd_1090a9ee-3fad-4085-b97f-bae07eef0fc3/whereabouts-cni-bincopy/0.log" Sep 18 13:39:33.841925 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:33.841903 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxnd_1090a9ee-3fad-4085-b97f-bae07eef0fc3/whereabouts-cni/0.log" Sep 18 13:39:34.279824 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:34.279788 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-npfmn_4dfc7c04-8dc1-4e9a-a4bf-5da9fc25aff7/kube-multus/0.log" Sep 18 13:39:34.356308 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:34.356278 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mkf52_7e79de33-0f2f-4207-9ea9-276b1f3744f2/network-metrics-daemon/0.log" Sep 18 13:39:34.373074 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:34.373044 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mkf52_7e79de33-0f2f-4207-9ea9-276b1f3744f2/kube-rbac-proxy/0.log" Sep 18 13:39:35.684953 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:35.684913 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsq6h_6735cebf-aaab-4717-b5e3-d729b812b2dd/ovn-controller/0.log" Sep 18 13:39:35.701757 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:35.701712 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsq6h_6735cebf-aaab-4717-b5e3-d729b812b2dd/ovn-acl-logging/0.log" Sep 18 13:39:35.726691 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:35.726661 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsq6h_6735cebf-aaab-4717-b5e3-d729b812b2dd/kube-rbac-proxy-node/0.log" Sep 18 13:39:35.751322 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:35.751289 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsq6h_6735cebf-aaab-4717-b5e3-d729b812b2dd/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 13:39:35.770896 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:35.770804 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsq6h_6735cebf-aaab-4717-b5e3-d729b812b2dd/northd/0.log" Sep 18 13:39:35.791684 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:35.791659 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsq6h_6735cebf-aaab-4717-b5e3-d729b812b2dd/nbdb/0.log" Sep 18 13:39:35.813557 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:35.813531 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsq6h_6735cebf-aaab-4717-b5e3-d729b812b2dd/sbdb/0.log" Sep 18 13:39:35.878126 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:35.878104 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsq6h_6735cebf-aaab-4717-b5e3-d729b812b2dd/ovnkube-controller/0.log" Sep 18 13:39:36.959938 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:36.959904 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-f9l47_d7ecc191-ecaa-4911-9fbd-3150a630dba6/network-check-target-container/0.log" Sep 18 13:39:37.967320 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:37.967294 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6q8gw_7a2d3146-c0f0-48bc-822e-c7300770ebe6/iptables-alerter/0.log" Sep 18 13:39:38.651379 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:38.651356 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hh48c_7b916f67-d86f-4473-8c30-fc5a908e8dd2/tuned/0.log" Sep 18 13:39:40.367111 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:40.367081 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-685d7d68b5-2wz4n_d7e5826f-5d50-4506-b584-4041ac4a35dc/cluster-samples-operator/0.log" Sep 18 13:39:40.397901 ip-10-0-129-232 kubenswrapper[2580]: I0918 13:39:40.397874 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-685d7d68b5-2wz4n_d7e5826f-5d50-4506-b584-4041ac4a35dc/cluster-samples-operator-watch/0.log"