Jul 07 06:29:40.307017 ip-10-0-129-39 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 06:29:40.307033 ip-10-0-129-39 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 06:29:40.307043 ip-10-0-129-39 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 06:29:40.307458 ip-10-0-129-39 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 06:29:50.468011 ip-10-0-129-39 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 06:29:50.468031 ip-10-0-129-39 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cb8a593cb1db4aea81f1f15f3e17a16f -- Jul 07 06:31:26.870341 ip-10-0-129-39 systemd[1]: Starting Kubernetes Kubelet... Jul 07 06:31:27.316528 ip-10-0-129-39 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 06:31:27.316528 ip-10-0-129-39 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 06:31:27.316528 ip-10-0-129-39 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 06:31:27.316528 ip-10-0-129-39 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 06:31:27.316528 ip-10-0-129-39 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 06:31:27.318702 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.318619 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 06:31:27.323687 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323671 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323689 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323693 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323697 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323700 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323702 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323705 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323708 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323710 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323713 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323715 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323718 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323720 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323723 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323725 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323728 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323731 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323733 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323737 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:31:27.323730 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323740 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323742 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323745 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323748 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323751 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323753 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323756 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323758 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323761 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323763 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323766 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323769 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323771 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323774 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323776 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323779 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323781 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323783 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323786 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323788 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:31:27.324204 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323791 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323793 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323795 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323798 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323800 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323803 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323805 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323808 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323810 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323812 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323815 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323817 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323819 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323822 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323825 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323828 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323831 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323834 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323836 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323839 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:31:27.324677 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323842 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323844 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323847 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323849 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323851 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323854 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323857 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323859 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323862 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323864 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323866 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323869 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323871 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323874 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323877 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323879 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323882 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323884 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323888 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323891 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:31:27.325193 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323895 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323898 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323901 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323904 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323908 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323913 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323916 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323919 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323922 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323924 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323927 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323930 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323932 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323935 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323937 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323939 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323942 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323945 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323947 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:31:27.325672 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.323950 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324692 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324701 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324705 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324708 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324710 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324714 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324717 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324720 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324723 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324725 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324728 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324730 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324733 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324735 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324738 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324740 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324743 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324746 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:31:27.326159 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324749 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324751 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324754 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324756 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324759 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324761 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324764 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324766 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324768 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324771 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324774 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324776 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324779 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324781 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324784 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324786 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324789 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324791 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324794 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324796 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:31:27.326622 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324799 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324802 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324804 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324807 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324809 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324812 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324814 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324817 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324819 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324821 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324824 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324827 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324830 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324832 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324835 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324837 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324840 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324842 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324845 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:31:27.327122 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324847 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324851 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324854 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324857 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324860 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324863 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324865 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324868 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324871 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324873 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324877 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324879 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324882 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324886 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324890 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324892 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324895 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324897 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324899 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324902 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:31:27.327587 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324904 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324908 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324911 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324914 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324916 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324919 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324922 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324924 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324927 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324929 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324932 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324934 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324937 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324939 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324942 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324944 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324947 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324949 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324951 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:31:27.328186 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324954 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324956 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.324959 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325347 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325352 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325355 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325360 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325363 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325366 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325369 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325372 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325374 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325377 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325380 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325382 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325384 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325387 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325390 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325392 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325395 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:31:27.328655 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325397 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325400 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325402 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325405 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325408 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325410 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325413 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325415 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325417 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325420 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325423 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325425 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325428 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325430 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325432 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325435 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325437 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325440 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325443 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325446 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:31:27.329166 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325449 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325452 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325454 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325457 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325459 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325462 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325464 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325467 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325469 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325472 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325474 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325476 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325479 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325481 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325484 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325486 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325489 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325491 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325494 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325497 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:31:27.329639 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325499 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325502 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325504 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325507 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325509 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325512 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325514 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325517 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325520 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325522 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325526 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325530 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325534 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325538 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325541 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325544 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325548 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325551 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325554 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325557 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:31:27.330175 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325560 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325562 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325565 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325567 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325571 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325574 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325577 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325580 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325582 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325585 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325588 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325590 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325592 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325595 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325597 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325600 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325602 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325605 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325607 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:31:27.330664 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325610 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325613 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.325615 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325684 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325691 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325696 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325700 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325705 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325708 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325712 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325716 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325719 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325722 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325725 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325729 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325731 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325734 2575 flags.go:64] FLAG: --cgroup-root="" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325737 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325740 2575 flags.go:64] FLAG: --client-ca-file="" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325743 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325745 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325750 2575 flags.go:64] FLAG: --cluster-domain="" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325753 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325756 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 06:31:27.331188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325758 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325762 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325765 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325768 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325771 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325774 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325777 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325779 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325782 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325785 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325788 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325794 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325797 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325800 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325803 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325805 2575 flags.go:64] FLAG: --enable-server="true" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325809 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325812 2575 flags.go:64] FLAG: --event-burst="100" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325816 2575 flags.go:64] FLAG: --event-qps="50" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325818 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325821 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325824 2575 flags.go:64] FLAG: --eviction-hard="" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325827 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325830 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325833 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 06:31:27.331753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325835 2575 flags.go:64] FLAG: --eviction-soft="" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325838 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325841 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325844 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325846 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325849 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325853 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325855 2575 flags.go:64] FLAG: --feature-gates="" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325859 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325862 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325865 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325868 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325871 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325874 2575 flags.go:64] FLAG: --help="false" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325876 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325879 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325882 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325885 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325891 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325894 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325897 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325900 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325902 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 06:31:27.332378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325905 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325908 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325911 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325914 2575 flags.go:64] FLAG: --kube-reserved="" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325917 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325920 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325923 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325925 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325928 2575 flags.go:64] FLAG: --lock-file="" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325930 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325933 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325936 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325941 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325943 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325946 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325949 2575 flags.go:64] FLAG: --logging-format="text" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325951 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325954 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325957 2575 flags.go:64] FLAG: --manifest-url="" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325960 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325964 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325966 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325970 2575 flags.go:64] FLAG: --max-pods="110" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325973 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325976 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 06:31:27.332952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325979 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325982 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325986 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325989 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325992 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.325999 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326002 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326005 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326008 2575 flags.go:64] FLAG: --pod-cidr="" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326011 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326037 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326040 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326043 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326046 2575 flags.go:64] FLAG: --port="10250" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326049 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326052 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09e32e9e9f552ad57" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326055 2575 flags.go:64] FLAG: --qos-reserved="" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326058 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326061 2575 flags.go:64] FLAG: --register-node="true" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326063 2575 flags.go:64] FLAG: --register-with-taints="" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326085 2575 flags.go:64] FLAG: --registry-burst="10" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326088 2575 flags.go:64] FLAG: --registry-qps="5" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326090 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326093 2575 flags.go:64] FLAG: --reserved-memory="" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326097 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 06:31:27.333645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326099 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326102 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326105 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326108 2575 flags.go:64] FLAG: --runonce="false" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326110 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326113 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326116 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326119 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326122 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326125 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326129 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326132 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326135 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326138 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326140 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326143 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326146 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326150 2575 flags.go:64] FLAG: --system-cgroups="" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326152 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326158 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326161 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326163 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326168 2575 flags.go:64] FLAG: --tls-min-version="" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326171 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326174 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 06:31:27.334266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326177 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326179 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326182 2575 flags.go:64] FLAG: --v="2" Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326186 2575 flags.go:64] FLAG: --version="false" Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326190 2575 flags.go:64] FLAG: --vmodule="" Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326193 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.326196 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326307 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326311 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326314 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326317 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326319 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326322 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326324 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326327 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326331 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326333 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326337 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326339 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326342 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326345 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:31:27.334901 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326347 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326351 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326355 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326358 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326361 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326364 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326366 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326369 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326371 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326374 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326376 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326379 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326381 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326384 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326386 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326389 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326391 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326394 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326396 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:31:27.335421 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326399 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326401 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326404 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326406 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326409 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326412 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326414 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326418 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326421 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326425 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326427 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326430 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326433 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326435 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326438 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326440 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326443 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326445 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326448 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326451 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:31:27.335890 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326453 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326456 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326458 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326460 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326463 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326465 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326469 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326472 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326474 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326477 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326479 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326482 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326484 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326486 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326488 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326491 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326493 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326496 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326498 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:31:27.336412 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326502 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326504 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326508 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326510 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326513 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326515 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326517 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326520 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326523 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326525 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326528 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326530 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326536 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326538 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326541 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326543 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326546 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326548 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326551 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326553 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:31:27.336879 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326556 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326558 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326560 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326563 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326567 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326570 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.326573 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.327409 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.334471 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.334484 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.335365 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.335372 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335426 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335431 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:31:27.337454 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335434 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335437 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335440 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335444 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335446 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335449 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335451 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335454 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335458 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335462 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335467 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335470 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335472 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335475 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335477 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335480 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335483 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335485 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335488 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:31:27.337793 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335490 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335493 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335495 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335498 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335500 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335502 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335505 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335507 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335510 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335514 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335516 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335519 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335521 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335523 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335526 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335529 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335531 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335534 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335536 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335540 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:31:27.338262 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335543 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335545 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335549 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335552 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335554 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335557 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335559 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335562 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335564 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335568 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335570 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335573 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335577 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335580 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335583 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335585 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335588 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335591 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335593 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335596 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:31:27.338799 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335599 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335601 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335604 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335607 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335609 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335612 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335614 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335617 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335619 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335622 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335624 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335626 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335629 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335631 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335634 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335636 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335638 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335641 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335644 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335646 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:31:27.339294 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335649 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335651 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335653 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335656 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335658 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335660 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335663 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335665 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335667 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335670 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335672 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335675 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335678 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335681 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335683 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335685 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335688 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:31:27.339777 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335690 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.335695 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335803 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335808 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335811 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335813 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335816 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335820 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335823 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335826 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335829 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335832 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335834 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335838 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:31:27.340212 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335840 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335843 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335845 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335848 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335850 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335853 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335855 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335858 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335860 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335862 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335865 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335867 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335870 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335873 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335875 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335878 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335880 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335883 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335885 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335887 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:31:27.340575 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335890 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335892 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335895 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335898 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335900 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335903 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335906 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335908 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335910 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335913 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335916 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335918 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335921 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335923 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335926 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335928 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335930 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335933 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335935 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:31:27.341052 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335938 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335940 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335942 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335945 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335947 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335950 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335952 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335954 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335958 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335961 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335964 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335967 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335969 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335971 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335974 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335976 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335979 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335981 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335983 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:31:27.341570 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335986 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335988 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335990 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335993 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335995 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.335998 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336000 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336003 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336005 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336008 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336010 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336013 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336015 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336017 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336019 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336022 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336024 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336027 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336029 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336031 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:31:27.342016 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336034 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336036 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336040 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336043 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336046 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336048 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336051 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336053 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:27.336056 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.336060 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.336169 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.338553 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.340183 2575 server.go:1019] "Starting client certificate rotation" Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.340285 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 06:31:27.342506 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.340339 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 06:31:27.342980 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.342967 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 06:31:27.347535 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.347515 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 06:31:27.365654 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.365629 2575 log.go:25] "Validated CRI v1 runtime API" Jul 07 06:31:27.368044 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.368027 2575 log.go:25] "Validated CRI v1 image API" Jul 07 06:31:27.368920 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.368892 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 06:31:27.372001 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.371983 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 06:31:27.373412 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.373386 2575 fs.go:135] Filesystem UUIDs: map[53927ce6-72e3-4777-aa11-1d055435dd91:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d8ba0965-a076-4f01-a637-dd3dadbe603c:/dev/nvme0n1p4] Jul 07 06:31:27.373487 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.373411 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 06:31:27.379192 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.379055 2575 manager.go:216] Machine: {Timestamp:2026-07-07 06:31:27.377643823 +0000 UTC m=+0.379723127 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108704 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bd6df9d2ba40cc832c9fb2924f6d7 SystemUUID:ec2bd6df-9d2b-a40c-c832-c9fb2924f6d7 BootID:cb8a593c-b1db-4aea-81f1-f15f3e17a16f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:eb:09:f4:05:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:eb:09:f4:05:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:ba:3b:a7:83:c0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 06:31:27.379192 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.379180 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 06:31:27.379352 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.379275 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 06:31:27.382859 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.382838 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 06:31:27.382987 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.382861 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 06:31:27.383732 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.383722 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 06:31:27.383773 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.383734 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 06:31:27.383773 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.383742 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 06:31:27.383773 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.383755 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 06:31:27.385669 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.385659 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 06:31:27.390297 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.390286 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 07 06:31:27.390420 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.390410 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 06:31:27.391172 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.391159 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 07 06:31:27.391213 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.391179 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 06:31:27.391213 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.391199 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 06:31:27.391213 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.391210 2575 kubelet.go:398] "Adding apiserver pod source" Jul 07 06:31:27.391304 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.391219 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 06:31:27.391568 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.391557 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 06:31:27.391607 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.391578 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 06:31:27.393968 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.393953 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 06:31:27.396324 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.396309 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 06:31:27.396413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.396348 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 06:31:27.397838 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397823 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397844 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397853 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397860 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397871 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397879 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397890 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397898 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397907 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397915 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397927 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 06:31:27.397937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.397935 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 06:31:27.398921 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.398910 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 06:31:27.398974 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.398923 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 06:31:27.399338 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.399317 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 06:31:27.399541 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.399522 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 06:31:27.402199 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.402183 2575 server.go:1268] "Started kubelet" Jul 07 06:31:27.402286 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.402250 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 06:31:27.406372 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.406332 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 06:31:27.406659 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.402277 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 06:31:27.406751 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.406684 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 06:31:27.407144 ip-10-0-129-39 systemd[1]: Started Kubernetes Kubelet. Jul 07 06:31:27.408928 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.408909 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 06:31:27.409044 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.409000 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 07 06:31:27.412205 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.412186 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 06:31:27.414605 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.413461 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-39.ec2.internal.18bfee34a8f2052d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-39.ec2.internal,UID:ip-10-0-129-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-39.ec2.internal,},FirstTimestamp:2026-07-07 06:31:27.402149165 +0000 UTC m=+0.404228470,LastTimestamp:2026-07-07 06:31:27.402149165 +0000 UTC m=+0.404228470,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-39.ec2.internal,}" Jul 07 06:31:27.423009 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.422851 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 06:31:27.423099 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.422856 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 06:31:27.423472 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.423410 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:27.423773 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.423756 2575 factory.go:55] Registering systemd factory Jul 07 06:31:27.423773 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.423774 2575 factory.go:223] Registration of the systemd container factory successfully Jul 07 06:31:27.423918 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.423821 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 06:31:27.423918 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.423833 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 06:31:27.423918 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.423846 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 06:31:27.423918 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.423916 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 07 06:31:27.424051 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.423925 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 07 06:31:27.424968 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.424948 2575 factory.go:153] Registering CRI-O factory Jul 07 06:31:27.424968 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.424969 2575 factory.go:223] Registration of the crio container factory successfully Jul 07 06:31:27.425141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.425053 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 06:31:27.425141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.425093 2575 factory.go:103] Registering Raw factory Jul 07 06:31:27.425141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.425108 2575 manager.go:1196] Started watching for new ooms in manager Jul 07 06:31:27.425380 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.425356 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gd84w" Jul 07 06:31:27.425555 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.425527 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 06:31:27.425628 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.425583 2575 manager.go:349] Starting recovery of all containers Jul 07 06:31:27.425778 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.425744 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 06:31:27.433527 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.433498 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gd84w" Jul 07 06:31:27.434446 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.434432 2575 manager.go:354] Recovery completed Jul 07 06:31:27.438086 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.438060 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:31:27.439953 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.439938 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:31:27.440027 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.439964 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:31:27.440027 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.439973 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:31:27.440500 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.440483 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 06:31:27.440500 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.440494 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:31:27.440500 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.440500 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 06:31:27.440640 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.440519 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 07 06:31:27.441196 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.441183 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:31:27.441245 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.441209 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:31:27.441245 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.441219 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:31:27.442525 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.442512 2575 policy_none.go:49] "None policy: Start" Jul 07 06:31:27.442579 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.442531 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 06:31:27.442579 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.442546 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 06:31:27.444606 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.444594 2575 policy_none.go:47] "Start" Jul 07 06:31:27.491640 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.491624 2575 manager.go:337] "Starting Device Plugin manager" Jul 07 06:31:27.501451 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.491656 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 06:31:27.501451 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.491665 2575 server.go:87] "Starting device plugin registration server" Jul 07 06:31:27.501451 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.491916 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 06:31:27.501451 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.491929 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 06:31:27.501451 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.491997 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 06:31:27.501451 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.492095 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 06:31:27.501451 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.492105 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 06:31:27.501451 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.492574 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 06:31:27.501451 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.492612 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:27.519506 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.519475 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 06:31:27.520837 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.520822 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 06:31:27.520905 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.520857 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 06:31:27.520905 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.520876 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 06:31:27.520905 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.520903 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 06:31:27.522766 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.522749 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 06:31:27.593000 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.592942 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:31:27.593907 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.593893 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:31:27.593987 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.593925 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:31:27.593987 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.593942 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:31:27.593987 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.593970 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.605382 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.605368 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.605447 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.605388 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-39.ec2.internal\": node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:27.621202 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.621184 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal"] Jul 07 06:31:27.621272 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.621242 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:31:27.622364 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.622351 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:31:27.622427 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.622369 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:31:27.622427 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.622382 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:31:27.624729 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.624716 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:31:27.624833 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.624819 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.624870 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.624845 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:31:27.625413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.625397 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:31:27.625479 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.625424 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:31:27.625479 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.625434 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:31:27.625479 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.625397 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:31:27.625588 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.625503 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:31:27.625588 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.625515 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:31:27.627668 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.627651 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.627728 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.627686 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:31:27.628334 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.628317 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:31:27.628413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.628340 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:31:27.628413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.628349 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:31:27.630299 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.630280 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:27.654585 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.654564 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-39.ec2.internal\" not found" node="ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.658561 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.658546 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-39.ec2.internal\" not found" node="ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.725164 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.725142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9178fa6a4c12c534b2a4b3275d3b9775-config\") pod \"kube-apiserver-proxy-ip-10-0-129-39.ec2.internal\" (UID: \"9178fa6a4c12c534b2a4b3275d3b9775\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.725250 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.725170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f2a5517e65a2e6eea49dbce93563b2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"2f2a5517e65a2e6eea49dbce93563b2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.725250 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.725195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f2a5517e65a2e6eea49dbce93563b2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"2f2a5517e65a2e6eea49dbce93563b2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.731231 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.731213 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:27.825631 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.825611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f2a5517e65a2e6eea49dbce93563b2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"2f2a5517e65a2e6eea49dbce93563b2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.825689 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.825636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9178fa6a4c12c534b2a4b3275d3b9775-config\") pod \"kube-apiserver-proxy-ip-10-0-129-39.ec2.internal\" (UID: \"9178fa6a4c12c534b2a4b3275d3b9775\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.825689 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.825652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f2a5517e65a2e6eea49dbce93563b2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"2f2a5517e65a2e6eea49dbce93563b2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.825757 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.825708 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f2a5517e65a2e6eea49dbce93563b2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"2f2a5517e65a2e6eea49dbce93563b2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.825757 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.825721 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9178fa6a4c12c534b2a4b3275d3b9775-config\") pod \"kube-apiserver-proxy-ip-10-0-129-39.ec2.internal\" (UID: \"9178fa6a4c12c534b2a4b3275d3b9775\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.825757 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.825710 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f2a5517e65a2e6eea49dbce93563b2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"2f2a5517e65a2e6eea49dbce93563b2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.831724 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.831705 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:27.932455 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:27.932408 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:27.957587 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.957571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Jul 07 06:31:27.961146 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:27.961133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Jul 07 06:31:28.033170 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:28.033145 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:28.133653 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:28.133632 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:28.234182 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:28.234124 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:28.334638 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:28.334617 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:28.339774 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:28.339758 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 06:31:28.339917 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:28.339899 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 06:31:28.435519 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:28.435485 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:28.436580 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:28.436557 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 06:26:27 +0000 UTC" deadline="2027-12-01 19:53:14.793958182 +0000 UTC" Jul 07 06:31:28.436631 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:28.436580 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12301h21m46.357380807s" Jul 07 06:31:28.491649 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:28.491595 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2a5517e65a2e6eea49dbce93563b2c.slice/crio-53c1840f0563831561bca7db9101c914108775db7441d5ef06d130ac4470b868 WatchSource:0}: Error finding container 53c1840f0563831561bca7db9101c914108775db7441d5ef06d130ac4470b868: Status 404 returned error can't find the container with id 53c1840f0563831561bca7db9101c914108775db7441d5ef06d130ac4470b868 Jul 07 06:31:28.492251 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:28.492211 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9178fa6a4c12c534b2a4b3275d3b9775.slice/crio-6322f55bf4f1fc9b50a929d8d4bdc637c92ee07b6980cb616ec042774bbc5860 WatchSource:0}: Error finding container 6322f55bf4f1fc9b50a929d8d4bdc637c92ee07b6980cb616ec042774bbc5860: Status 404 returned error can't find the container with id 6322f55bf4f1fc9b50a929d8d4bdc637c92ee07b6980cb616ec042774bbc5860 Jul 07 06:31:28.498181 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:28.498163 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 06:31:28.523636 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:28.523591 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" event={"ID":"9178fa6a4c12c534b2a4b3275d3b9775","Type":"ContainerStarted","Data":"6322f55bf4f1fc9b50a929d8d4bdc637c92ee07b6980cb616ec042774bbc5860"} Jul 07 06:31:28.524604 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:28.524584 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" event={"ID":"2f2a5517e65a2e6eea49dbce93563b2c","Type":"ContainerStarted","Data":"53c1840f0563831561bca7db9101c914108775db7441d5ef06d130ac4470b868"} Jul 07 06:31:28.530458 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:28.530440 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 06:31:28.535758 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:28.535740 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:28.636262 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:28.636241 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:28.736764 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:28.736743 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:28.837252 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:28.837198 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:28.938032 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:28.937995 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Jul 07 06:31:28.949229 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:28.949204 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 06:31:28.983884 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:28.983859 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 06:31:29.024460 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.024427 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Jul 07 06:31:29.040933 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.040909 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 06:31:29.042095 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.042076 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Jul 07 06:31:29.053601 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.053575 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 06:31:29.392296 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.392267 2575 apiserver.go:52] "Watching apiserver" Jul 07 06:31:29.402190 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.402162 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 06:31:29.404081 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.404044 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-ph8qs","kube-system/konnectivity-agent-drc6p","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s","openshift-dns/node-resolver-j8bqh","openshift-image-registry/node-ca-r949v","openshift-network-diagnostics/network-check-target-rcpd5","openshift-network-operator/iptables-alerter-g2qqq","openshift-ovn-kubernetes/ovnkube-node-j79sd","kube-system/global-pull-secret-syncer-zmwbj","kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pgjmx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal","openshift-multus/multus-additional-cni-plugins-rwkn7","openshift-multus/multus-pqq72"] Jul 07 06:31:29.406999 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.406977 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.409277 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.409257 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.409890 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.409867 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:31:29.410000 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.409986 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 06:31:29.410212 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.410092 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pr94r\"" Jul 07 06:31:29.410627 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.410604 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 06:31:29.411679 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.411657 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.412165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.412116 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 06:31:29.412165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.412159 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 06:31:29.412322 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.412191 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9zldw\"" Jul 07 06:31:29.412429 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.412409 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 06:31:29.412502 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.412473 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 06:31:29.412502 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.412480 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 06:31:29.414052 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.414033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.414749 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.414534 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 06:31:29.414749 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.414587 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 06:31:29.414901 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.414771 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 06:31:29.415473 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.415118 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vxfsc\"" Jul 07 06:31:29.417679 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.416928 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.419129 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.418851 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:29.419129 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.418918 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:29.421648 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.421628 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:29.421757 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.421709 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:29.424071 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.424048 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 06:31:29.424328 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.424299 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:29.424425 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.424386 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:29.426145 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.426080 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4tg7h\"" Jul 07 06:31:29.426375 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.426356 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 06:31:29.426564 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.426533 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:29.427283 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.426793 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 06:31:29.427389 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.427372 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 06:31:29.427485 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.426927 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jj4sd\"" Jul 07 06:31:29.427522 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.426873 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 06:31:29.427718 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.427699 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 06:31:29.429082 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.428766 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.431726 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.431704 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.434169 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.434135 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.435118 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.435102 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 06:31:29.435343 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.435319 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k6plg\"" Jul 07 06:31:29.435423 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.435408 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 06:31:29.437421 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-etc-selinux\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.437525 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/39efcee3-3895-4b99-883c-273bba95191b-serviceca\") pod \"node-ca-r949v\" (UID: \"39efcee3-3895-4b99-883c-273bba95191b\") " pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.437525 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:29.437525 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bc4126b-dd20-4d97-b66f-09366cc64d3e-host-slash\") pod \"iptables-alerter-g2qqq\" (UID: \"9bc4126b-dd20-4d97-b66f-09366cc64d3e\") " pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.437698 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437532 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp64f\" (UniqueName: \"kubernetes.io/projected/16ab1acc-1355-4186-b4e0-51fbf6241b3b-kube-api-access-qp64f\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.437698 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:29.437698 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m77f\" (UniqueName: \"kubernetes.io/projected/bc2b4af1-d047-4ad8-8951-c1a020da2030-kube-api-access-6m77f\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:29.437698 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437613 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-registration-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.437698 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39efcee3-3895-4b99-883c-273bba95191b-host\") pod \"node-ca-r949v\" (UID: \"39efcee3-3895-4b99-883c-273bba95191b\") " pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.437698 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-kubelet-config\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:29.437698 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437689 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90d97f41-cf09-4bde-aab1-b29ab0050234-agent-certs\") pod \"konnectivity-agent-drc6p\" (UID: \"90d97f41-cf09-4bde-aab1-b29ab0050234\") " pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:29.437903 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437715 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16ab1acc-1355-4186-b4e0-51fbf6241b3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.437903 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.437903 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-sys-fs\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.437903 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-dbus\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:29.437903 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bc4126b-dd20-4d97-b66f-09366cc64d3e-iptables-alerter-script\") pod \"iptables-alerter-g2qqq\" (UID: \"9bc4126b-dd20-4d97-b66f-09366cc64d3e\") " pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.437903 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437892 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.438141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sfb4\" (UniqueName: \"kubernetes.io/projected/39efcee3-3895-4b99-883c-273bba95191b-kube-api-access-2sfb4\") pod \"node-ca-r949v\" (UID: \"39efcee3-3895-4b99-883c-273bba95191b\") " pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.438141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-system-cni-dir\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.438141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-socket-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.438141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.437993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-device-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.438141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2pkl\" (UniqueName: \"kubernetes.io/projected/6336a8df-6a20-4970-a22b-79bdbdd9574e-kube-api-access-g2pkl\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.438141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgkzt\" (UniqueName: \"kubernetes.io/projected/9bc4126b-dd20-4d97-b66f-09366cc64d3e-kube-api-access-mgkzt\") pod \"iptables-alerter-g2qqq\" (UID: \"9bc4126b-dd20-4d97-b66f-09366cc64d3e\") " pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.438141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-cnibin\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.438507 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438177 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16ab1acc-1355-4186-b4e0-51fbf6241b3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.438507 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3b3ec4a-096e-4f79-9637-0a030bbeb608-hosts-file\") pod \"node-resolver-j8bqh\" (UID: \"e3b3ec4a-096e-4f79-9637-0a030bbeb608\") " pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.438507 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438272 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3b3ec4a-096e-4f79-9637-0a030bbeb608-tmp-dir\") pod \"node-resolver-j8bqh\" (UID: \"e3b3ec4a-096e-4f79-9637-0a030bbeb608\") " pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.438507 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqng6\" (UniqueName: \"kubernetes.io/projected/e3b3ec4a-096e-4f79-9637-0a030bbeb608-kube-api-access-dqng6\") pod \"node-resolver-j8bqh\" (UID: \"e3b3ec4a-096e-4f79-9637-0a030bbeb608\") " pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.438507 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90d97f41-cf09-4bde-aab1-b29ab0050234-konnectivity-ca\") pod \"konnectivity-agent-drc6p\" (UID: \"90d97f41-cf09-4bde-aab1-b29ab0050234\") " pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:29.438507 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438356 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-os-release\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.438507 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16ab1acc-1355-4186-b4e0-51fbf6241b3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.438507 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.438407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n9nl\" (UniqueName: \"kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl\") pod \"network-check-target-rcpd5\" (UID: \"54902f7d-66fe-49c9-a0e2-70bf30a93765\") " pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:29.439174 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.439131 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:31:29.439787 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.439316 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6rq4j\"" Jul 07 06:31:29.439787 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.439339 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 06:31:29.439787 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.439366 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 06:31:29.439787 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.439394 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 06:31:29.439787 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.439316 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 06:31:29.439787 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.439548 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xz9j9\"" Jul 07 06:31:29.439787 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.439699 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m97kb\"" Jul 07 06:31:29.440264 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.440249 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 06:31:29.444639 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.444617 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 06:31:29.444749 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.444688 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 06:31:29.444941 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.444924 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 06:31:29.448455 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.448433 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 06:31:29.469462 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.469434 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vhv52" Jul 07 06:31:29.476989 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.476970 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vhv52" Jul 07 06:31:29.489594 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.489573 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 06:31:29.525127 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.525102 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 06:31:29.538592 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538563 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c02539c3-5803-4598-9bae-d4f89bd37a53-ovn-node-metrics-cert\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.538679 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-run-multus-certs\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.538679 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538631 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-sysctl-d\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.538679 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-sysctl-conf\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.538829 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-etc-selinux\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.538829 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/39efcee3-3895-4b99-883c-273bba95191b-serviceca\") pod \"node-ca-r949v\" (UID: \"39efcee3-3895-4b99-883c-273bba95191b\") " pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.538829 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538744 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:29.538829 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-run-k8s-cni-cncf-io\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.538829 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dn4f\" (UniqueName: \"kubernetes.io/projected/29e5136f-635a-4615-9dd8-46155addba05-kube-api-access-2dn4f\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.538829 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-run-netns\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538861 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bc4126b-dd20-4d97-b66f-09366cc64d3e-host-slash\") pod \"iptables-alerter-g2qqq\" (UID: \"9bc4126b-dd20-4d97-b66f-09366cc64d3e\") " pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538884 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-etc-selinux\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.538894 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538901 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bc4126b-dd20-4d97-b66f-09366cc64d3e-host-slash\") pod \"iptables-alerter-g2qqq\" (UID: \"9bc4126b-dd20-4d97-b66f-09366cc64d3e\") " pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp64f\" (UniqueName: \"kubernetes.io/projected/16ab1acc-1355-4186-b4e0-51fbf6241b3b-kube-api-access-qp64f\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.538954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.538979 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret podName:cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:30.03895464 +0000 UTC m=+3.041033952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret") pod "global-pull-secret-syncer-zmwbj" (UID: "cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e5527f6-1a0f-477a-8f94-b91c8f810269-cni-binary-copy\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.539023 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-socket-dir-parent\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.539068 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs podName:bc2b4af1-d047-4ad8-8951-c1a020da2030 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:30.039055701 +0000 UTC m=+3.041134993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs") pod "network-metrics-daemon-ph8qs" (UID: "bc2b4af1-d047-4ad8-8951-c1a020da2030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539083 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-conf-dir\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.539144 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-cni-bin\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5vd9\" (UniqueName: \"kubernetes.io/projected/c02539c3-5803-4598-9bae-d4f89bd37a53-kube-api-access-g5vd9\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39efcee3-3895-4b99-883c-273bba95191b-host\") pod \"node-ca-r949v\" (UID: \"39efcee3-3895-4b99-883c-273bba95191b\") " pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16ab1acc-1355-4186-b4e0-51fbf6241b3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539228 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39efcee3-3895-4b99-883c-273bba95191b-host\") pod \"node-ca-r949v\" (UID: \"39efcee3-3895-4b99-883c-273bba95191b\") " pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-host\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539276 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-systemd\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539288 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/39efcee3-3895-4b99-883c-273bba95191b-serviceca\") pod \"node-ca-r949v\" (UID: \"39efcee3-3895-4b99-883c-273bba95191b\") " pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539302 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-lib-modules\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sfb4\" (UniqueName: \"kubernetes.io/projected/39efcee3-3895-4b99-883c-273bba95191b-kube-api-access-2sfb4\") pod \"node-ca-r949v\" (UID: \"39efcee3-3895-4b99-883c-273bba95191b\") " pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-system-cni-dir\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539487 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29e5136f-635a-4615-9dd8-46155addba05-etc-tuned\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539542 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-system-cni-dir\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-slash\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539581 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c02539c3-5803-4598-9bae-d4f89bd37a53-ovnkube-script-lib\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2pkl\" (UniqueName: \"kubernetes.io/projected/6336a8df-6a20-4970-a22b-79bdbdd9574e-kube-api-access-g2pkl\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgkzt\" (UniqueName: \"kubernetes.io/projected/9bc4126b-dd20-4d97-b66f-09366cc64d3e-kube-api-access-mgkzt\") pod \"iptables-alerter-g2qqq\" (UID: \"9bc4126b-dd20-4d97-b66f-09366cc64d3e\") " pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.539878 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539645 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-cnibin\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29e5136f-635a-4615-9dd8-46155addba05-tmp\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-var-lib-openvswitch\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539721 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-cnibin\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-etc-openvswitch\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16ab1acc-1355-4186-b4e0-51fbf6241b3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3b3ec4a-096e-4f79-9637-0a030bbeb608-hosts-file\") pod \"node-resolver-j8bqh\" (UID: \"e3b3ec4a-096e-4f79-9637-0a030bbeb608\") " pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-var-lib-kubelet\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539798 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16ab1acc-1355-4186-b4e0-51fbf6241b3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-cni-netd\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539909 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c02539c3-5803-4598-9bae-d4f89bd37a53-ovnkube-config\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539934 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3b3ec4a-096e-4f79-9637-0a030bbeb608-hosts-file\") pod \"node-resolver-j8bqh\" (UID: \"e3b3ec4a-096e-4f79-9637-0a030bbeb608\") " pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539937 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90d97f41-cf09-4bde-aab1-b29ab0050234-konnectivity-ca\") pod \"konnectivity-agent-drc6p\" (UID: \"90d97f41-cf09-4bde-aab1-b29ab0050234\") " pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.539977 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-os-release\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16ab1acc-1355-4186-b4e0-51fbf6241b3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.540758 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540050 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9nl\" (UniqueName: \"kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl\") pod \"network-check-target-rcpd5\" (UID: \"54902f7d-66fe-49c9-a0e2-70bf30a93765\") " pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540077 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-os-release\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-run-netns\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540118 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-os-release\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-var-lib-cni-multus\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-etc-kubernetes\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-kubernetes\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-run\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540263 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-sys\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540289 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-systemd-units\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540302 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16ab1acc-1355-4186-b4e0-51fbf6241b3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-run-systemd\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540344 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m77f\" (UniqueName: \"kubernetes.io/projected/bc2b4af1-d047-4ad8-8951-c1a020da2030-kube-api-access-6m77f\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-hostroot\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-modprobe-d\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-sysconfig\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540460 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-run-openvswitch\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.541459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540484 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-log-socket\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540489 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90d97f41-cf09-4bde-aab1-b29ab0050234-konnectivity-ca\") pod \"konnectivity-agent-drc6p\" (UID: \"90d97f41-cf09-4bde-aab1-b29ab0050234\") " pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-registration-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540543 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-kubelet-config\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90d97f41-cf09-4bde-aab1-b29ab0050234-agent-certs\") pod \"konnectivity-agent-drc6p\" (UID: \"90d97f41-cf09-4bde-aab1-b29ab0050234\") " pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540574 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-registration-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-cnibin\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540607 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-kubelet-config\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-kubelet\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540713 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-sys-fs\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540760 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16ab1acc-1355-4186-b4e0-51fbf6241b3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540762 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540764 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-dbus\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540810 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-sys-fs\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bc4126b-dd20-4d97-b66f-09366cc64d3e-iptables-alerter-script\") pod \"iptables-alerter-g2qqq\" (UID: \"9bc4126b-dd20-4d97-b66f-09366cc64d3e\") " pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.542319 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540877 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-daemon-config\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540897 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-dbus\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540917 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c668d\" (UniqueName: \"kubernetes.io/projected/0e5527f6-1a0f-477a-8f94-b91c8f810269-kube-api-access-c668d\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-node-log\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540960 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-run-ovn\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.540981 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-socket-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-device-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-cni-dir\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541053 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16ab1acc-1355-4186-b4e0-51fbf6241b3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-var-lib-kubelet\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3b3ec4a-096e-4f79-9637-0a030bbeb608-tmp-dir\") pod \"node-resolver-j8bqh\" (UID: \"e3b3ec4a-096e-4f79-9637-0a030bbeb608\") " pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541146 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-device-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqng6\" (UniqueName: \"kubernetes.io/projected/e3b3ec4a-096e-4f79-9637-0a030bbeb608-kube-api-access-dqng6\") pod \"node-resolver-j8bqh\" (UID: \"e3b3ec4a-096e-4f79-9637-0a030bbeb608\") " pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541185 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6336a8df-6a20-4970-a22b-79bdbdd9574e-socket-dir\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-system-cni-dir\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541234 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-var-lib-cni-bin\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.543141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541263 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-run-ovn-kubernetes\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.543965 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541287 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c02539c3-5803-4598-9bae-d4f89bd37a53-env-overrides\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.543965 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541329 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bc4126b-dd20-4d97-b66f-09366cc64d3e-iptables-alerter-script\") pod \"iptables-alerter-g2qqq\" (UID: \"9bc4126b-dd20-4d97-b66f-09366cc64d3e\") " pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.543965 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.541478 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3b3ec4a-096e-4f79-9637-0a030bbeb608-tmp-dir\") pod \"node-resolver-j8bqh\" (UID: \"e3b3ec4a-096e-4f79-9637-0a030bbeb608\") " pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.545825 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.545800 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90d97f41-cf09-4bde-aab1-b29ab0050234-agent-certs\") pod \"konnectivity-agent-drc6p\" (UID: \"90d97f41-cf09-4bde-aab1-b29ab0050234\") " pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:29.551182 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.550528 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:31:29.551182 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.550550 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:31:29.551182 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.550564 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2n9nl for pod openshift-network-diagnostics/network-check-target-rcpd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:29.551182 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:29.550626 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl podName:54902f7d-66fe-49c9-a0e2-70bf30a93765 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:30.05061193 +0000 UTC m=+3.052691222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2n9nl" (UniqueName: "kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl") pod "network-check-target-rcpd5" (UID: "54902f7d-66fe-49c9-a0e2-70bf30a93765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:29.553509 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.553433 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgkzt\" (UniqueName: \"kubernetes.io/projected/9bc4126b-dd20-4d97-b66f-09366cc64d3e-kube-api-access-mgkzt\") pod \"iptables-alerter-g2qqq\" (UID: \"9bc4126b-dd20-4d97-b66f-09366cc64d3e\") " pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.553851 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.553827 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqng6\" (UniqueName: \"kubernetes.io/projected/e3b3ec4a-096e-4f79-9637-0a030bbeb608-kube-api-access-dqng6\") pod \"node-resolver-j8bqh\" (UID: \"e3b3ec4a-096e-4f79-9637-0a030bbeb608\") " pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.555914 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.555868 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m77f\" (UniqueName: \"kubernetes.io/projected/bc2b4af1-d047-4ad8-8951-c1a020da2030-kube-api-access-6m77f\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:29.558950 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.558473 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sfb4\" (UniqueName: \"kubernetes.io/projected/39efcee3-3895-4b99-883c-273bba95191b-kube-api-access-2sfb4\") pod \"node-ca-r949v\" (UID: \"39efcee3-3895-4b99-883c-273bba95191b\") " pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.558950 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.558911 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2pkl\" (UniqueName: \"kubernetes.io/projected/6336a8df-6a20-4970-a22b-79bdbdd9574e-kube-api-access-g2pkl\") pod \"aws-ebs-csi-driver-node-9fv2s\" (UID: \"6336a8df-6a20-4970-a22b-79bdbdd9574e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.559920 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.559896 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp64f\" (UniqueName: \"kubernetes.io/projected/16ab1acc-1355-4186-b4e0-51fbf6241b3b-kube-api-access-qp64f\") pod \"multus-additional-cni-plugins-rwkn7\" (UID: \"16ab1acc-1355-4186-b4e0-51fbf6241b3b\") " pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.641977 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.641803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-node-log\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.641977 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.641855 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-run-ovn\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.641977 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.641905 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-run-ovn\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.641977 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.641925 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-node-log\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.641977 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.641956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-cni-dir\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.641993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-var-lib-kubelet\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642056 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-var-lib-kubelet\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642096 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-system-cni-dir\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642129 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-var-lib-cni-bin\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-run-ovn-kubernetes\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642164 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c02539c3-5803-4598-9bae-d4f89bd37a53-env-overrides\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642170 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-system-cni-dir\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c02539c3-5803-4598-9bae-d4f89bd37a53-ovn-node-metrics-cert\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642197 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-var-lib-cni-bin\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642098 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-cni-dir\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-run-multus-certs\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642253 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-run-multus-certs\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642256 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-run-ovn-kubernetes\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642259 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-sysctl-d\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-sysctl-conf\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-run-k8s-cni-cncf-io\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642370 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dn4f\" (UniqueName: \"kubernetes.io/projected/29e5136f-635a-4615-9dd8-46155addba05-kube-api-access-2dn4f\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.642413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-run-netns\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642403 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-sysctl-d\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642432 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-sysctl-conf\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642432 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e5527f6-1a0f-477a-8f94-b91c8f810269-cni-binary-copy\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642448 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-run-k8s-cni-cncf-io\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642461 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-socket-dir-parent\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-conf-dir\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642492 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-cni-bin\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642509 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5vd9\" (UniqueName: \"kubernetes.io/projected/c02539c3-5803-4598-9bae-d4f89bd37a53-kube-api-access-g5vd9\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-host\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642541 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-systemd\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-lib-modules\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29e5136f-635a-4615-9dd8-46155addba05-etc-tuned\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-slash\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642608 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-cni-bin\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c02539c3-5803-4598-9bae-d4f89bd37a53-ovnkube-script-lib\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29e5136f-635a-4615-9dd8-46155addba05-tmp\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642669 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-socket-dir-parent\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.643344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642680 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-var-lib-openvswitch\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642695 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c02539c3-5803-4598-9bae-d4f89bd37a53-env-overrides\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-etc-openvswitch\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642708 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-conf-dir\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642770 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-slash\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642782 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-host\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642819 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-systemd\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e5527f6-1a0f-477a-8f94-b91c8f810269-cni-binary-copy\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-run-netns\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642914 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-lib-modules\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.642978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-var-lib-kubelet\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-cni-netd\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c02539c3-5803-4598-9bae-d4f89bd37a53-ovnkube-config\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-os-release\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-run-netns\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-var-lib-cni-multus\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-etc-kubernetes\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.644165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643143 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-kubernetes\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-run\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643192 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643208 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-sys\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643234 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-systemd-units\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643241 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-var-lib-kubelet\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-run-systemd\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-var-lib-openvswitch\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-hostroot\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-modprobe-d\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-hostroot\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643155 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-cni-netd\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643366 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c02539c3-5803-4598-9bae-d4f89bd37a53-ovnkube-script-lib\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643400 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-kubernetes\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643432 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-etc-openvswitch\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643484 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-systemd-units\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643494 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-modprobe-d\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643544 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-run\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.644944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643551 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-os-release\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643595 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-etc-kubernetes\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-sys\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643634 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-run-netns\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643644 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-host-var-lib-cni-multus\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-sysconfig\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643683 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-run-systemd\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-run-openvswitch\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643724 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29e5136f-635a-4615-9dd8-46155addba05-etc-sysconfig\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-log-socket\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643750 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-run-openvswitch\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-cnibin\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643775 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-log-socket\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-kubelet\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643804 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e5527f6-1a0f-477a-8f94-b91c8f810269-cnibin\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643799 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c02539c3-5803-4598-9bae-d4f89bd37a53-ovnkube-config\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643817 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-daemon-config\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643828 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c02539c3-5803-4598-9bae-d4f89bd37a53-host-kubelet\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.645672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.643843 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c668d\" (UniqueName: \"kubernetes.io/projected/0e5527f6-1a0f-477a-8f94-b91c8f810269-kube-api-access-c668d\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.646452 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.644258 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e5527f6-1a0f-477a-8f94-b91c8f810269-multus-daemon-config\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.646452 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.645806 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29e5136f-635a-4615-9dd8-46155addba05-tmp\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.646452 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.645859 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29e5136f-635a-4615-9dd8-46155addba05-etc-tuned\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.647639 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.647616 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c02539c3-5803-4598-9bae-d4f89bd37a53-ovn-node-metrics-cert\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.654607 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.654587 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dn4f\" (UniqueName: \"kubernetes.io/projected/29e5136f-635a-4615-9dd8-46155addba05-kube-api-access-2dn4f\") pod \"tuned-pgjmx\" (UID: \"29e5136f-635a-4615-9dd8-46155addba05\") " pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.655361 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.655338 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5vd9\" (UniqueName: \"kubernetes.io/projected/c02539c3-5803-4598-9bae-d4f89bd37a53-kube-api-access-g5vd9\") pod \"ovnkube-node-j79sd\" (UID: \"c02539c3-5803-4598-9bae-d4f89bd37a53\") " pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.656788 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.656771 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c668d\" (UniqueName: \"kubernetes.io/projected/0e5527f6-1a0f-477a-8f94-b91c8f810269-kube-api-access-c668d\") pod \"multus-pqq72\" (UID: \"0e5527f6-1a0f-477a-8f94-b91c8f810269\") " pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.721837 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.721803 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g2qqq" Jul 07 06:31:29.731083 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:29.731062 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc4126b_dd20_4d97_b66f_09366cc64d3e.slice/crio-678953e6f6929ea4a315657cc6d78c3cd7a0f888cc1be780ed097e1ae8c2263d WatchSource:0}: Error finding container 678953e6f6929ea4a315657cc6d78c3cd7a0f888cc1be780ed097e1ae8c2263d: Status 404 returned error can't find the container with id 678953e6f6929ea4a315657cc6d78c3cd7a0f888cc1be780ed097e1ae8c2263d Jul 07 06:31:29.731623 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.731600 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" Jul 07 06:31:29.740252 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:29.740226 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ab1acc_1355_4186_b4e0_51fbf6241b3b.slice/crio-62a9a31ebf15424a63052e1d6ec15462e6170e4572e5e1237df1d1cec1043108 WatchSource:0}: Error finding container 62a9a31ebf15424a63052e1d6ec15462e6170e4572e5e1237df1d1cec1043108: Status 404 returned error can't find the container with id 62a9a31ebf15424a63052e1d6ec15462e6170e4572e5e1237df1d1cec1043108 Jul 07 06:31:29.743329 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.743311 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" Jul 07 06:31:29.749476 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.749459 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j8bqh" Jul 07 06:31:29.752463 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:29.752444 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6336a8df_6a20_4970_a22b_79bdbdd9574e.slice/crio-0fb377f95c0a0d5da41803336c3fd4e856a6f777bf4bf3cbfc8d44063084a4c5 WatchSource:0}: Error finding container 0fb377f95c0a0d5da41803336c3fd4e856a6f777bf4bf3cbfc8d44063084a4c5: Status 404 returned error can't find the container with id 0fb377f95c0a0d5da41803336c3fd4e856a6f777bf4bf3cbfc8d44063084a4c5 Jul 07 06:31:29.758451 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:29.758430 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b3ec4a_096e_4f79_9637_0a030bbeb608.slice/crio-f101fc012b9eecf50ca9f88514058401d7960764efc77bf7d2f3f0320ffd2600 WatchSource:0}: Error finding container f101fc012b9eecf50ca9f88514058401d7960764efc77bf7d2f3f0320ffd2600: Status 404 returned error can't find the container with id f101fc012b9eecf50ca9f88514058401d7960764efc77bf7d2f3f0320ffd2600 Jul 07 06:31:29.761296 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.761278 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r949v" Jul 07 06:31:29.768610 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.768593 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:29.771043 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:29.771016 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39efcee3_3895_4b99_883c_273bba95191b.slice/crio-fbeb2c2193664b71985c31d2dda01757aae4afb8c6fcf8da02c05212a8fb1f35 WatchSource:0}: Error finding container fbeb2c2193664b71985c31d2dda01757aae4afb8c6fcf8da02c05212a8fb1f35: Status 404 returned error can't find the container with id fbeb2c2193664b71985c31d2dda01757aae4afb8c6fcf8da02c05212a8fb1f35 Jul 07 06:31:29.775993 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.775851 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pqq72" Jul 07 06:31:29.778650 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:29.778618 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90d97f41_cf09_4bde_aab1_b29ab0050234.slice/crio-f809332b54af1a867f6ae173da8e75546010395a6213cdc187c3ca4f170c7730 WatchSource:0}: Error finding container f809332b54af1a867f6ae173da8e75546010395a6213cdc187c3ca4f170c7730: Status 404 returned error can't find the container with id f809332b54af1a867f6ae173da8e75546010395a6213cdc187c3ca4f170c7730 Jul 07 06:31:29.782167 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.782074 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" Jul 07 06:31:29.785786 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:29.785757 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5527f6_1a0f_477a_8f94_b91c8f810269.slice/crio-1002ad665fe80db6578a5c49f8386231d0de16d0c9f291d5130afa3c12ec1159 WatchSource:0}: Error finding container 1002ad665fe80db6578a5c49f8386231d0de16d0c9f291d5130afa3c12ec1159: Status 404 returned error can't find the container with id 1002ad665fe80db6578a5c49f8386231d0de16d0c9f291d5130afa3c12ec1159 Jul 07 06:31:29.787228 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:29.787046 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:29.793554 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:29.793533 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e5136f_635a_4615_9dd8_46155addba05.slice/crio-0bdb37933456bca00f43a5f91a10afe09e3f6f847ae4ef53279e26bac1862ba7 WatchSource:0}: Error finding container 0bdb37933456bca00f43a5f91a10afe09e3f6f847ae4ef53279e26bac1862ba7: Status 404 returned error can't find the container with id 0bdb37933456bca00f43a5f91a10afe09e3f6f847ae4ef53279e26bac1862ba7 Jul 07 06:31:29.801013 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:31:29.800839 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc02539c3_5803_4598_9bae_d4f89bd37a53.slice/crio-f5a383b455a032ac710761652442ccbbb40afd713d763f3335d787b2ab70fc85 WatchSource:0}: Error finding container f5a383b455a032ac710761652442ccbbb40afd713d763f3335d787b2ab70fc85: Status 404 returned error can't find the container with id f5a383b455a032ac710761652442ccbbb40afd713d763f3335d787b2ab70fc85 Jul 07 06:31:30.047020 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.046930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:30.047020 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.046966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:30.047270 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:30.047127 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:30.047270 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:30.047209 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret podName:cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:31.047189574 +0000 UTC m=+4.049268882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret") pod "global-pull-secret-syncer-zmwbj" (UID: "cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:30.047270 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:30.047130 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:30.047270 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:30.047265 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs podName:bc2b4af1-d047-4ad8-8951-c1a020da2030 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:31.04725296 +0000 UTC m=+4.049332252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs") pod "network-metrics-daemon-ph8qs" (UID: "bc2b4af1-d047-4ad8-8951-c1a020da2030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:30.147973 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.147934 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9nl\" (UniqueName: \"kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl\") pod \"network-check-target-rcpd5\" (UID: \"54902f7d-66fe-49c9-a0e2-70bf30a93765\") " pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:30.148172 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:30.148158 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:31:30.148249 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:30.148183 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:31:30.148249 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:30.148197 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2n9nl for pod openshift-network-diagnostics/network-check-target-rcpd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:30.148361 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:30.148263 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl podName:54902f7d-66fe-49c9-a0e2-70bf30a93765 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:31.148242197 +0000 UTC m=+4.150321508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2n9nl" (UniqueName: "kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl") pod "network-check-target-rcpd5" (UID: "54902f7d-66fe-49c9-a0e2-70bf30a93765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:30.480894 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.480798 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 06:26:29 +0000 UTC" deadline="2028-03-27 19:40:32.711484508 +0000 UTC" Jul 07 06:31:30.480894 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.480837 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15109h9m2.230651019s" Jul 07 06:31:30.528653 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.528611 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" event={"ID":"c02539c3-5803-4598-9bae-d4f89bd37a53","Type":"ContainerStarted","Data":"f5a383b455a032ac710761652442ccbbb40afd713d763f3335d787b2ab70fc85"} Jul 07 06:31:30.529692 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.529668 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" event={"ID":"29e5136f-635a-4615-9dd8-46155addba05","Type":"ContainerStarted","Data":"0bdb37933456bca00f43a5f91a10afe09e3f6f847ae4ef53279e26bac1862ba7"} Jul 07 06:31:30.530799 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.530778 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j8bqh" event={"ID":"e3b3ec4a-096e-4f79-9637-0a030bbeb608","Type":"ContainerStarted","Data":"f101fc012b9eecf50ca9f88514058401d7960764efc77bf7d2f3f0320ffd2600"} Jul 07 06:31:30.531874 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.531852 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pqq72" event={"ID":"0e5527f6-1a0f-477a-8f94-b91c8f810269","Type":"ContainerStarted","Data":"1002ad665fe80db6578a5c49f8386231d0de16d0c9f291d5130afa3c12ec1159"} Jul 07 06:31:30.532920 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.532902 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drc6p" event={"ID":"90d97f41-cf09-4bde-aab1-b29ab0050234","Type":"ContainerStarted","Data":"f809332b54af1a867f6ae173da8e75546010395a6213cdc187c3ca4f170c7730"} Jul 07 06:31:30.533852 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.533836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r949v" event={"ID":"39efcee3-3895-4b99-883c-273bba95191b","Type":"ContainerStarted","Data":"fbeb2c2193664b71985c31d2dda01757aae4afb8c6fcf8da02c05212a8fb1f35"} Jul 07 06:31:30.534864 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.534846 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" event={"ID":"6336a8df-6a20-4970-a22b-79bdbdd9574e","Type":"ContainerStarted","Data":"0fb377f95c0a0d5da41803336c3fd4e856a6f777bf4bf3cbfc8d44063084a4c5"} Jul 07 06:31:30.535870 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.535852 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" event={"ID":"16ab1acc-1355-4186-b4e0-51fbf6241b3b","Type":"ContainerStarted","Data":"62a9a31ebf15424a63052e1d6ec15462e6170e4572e5e1237df1d1cec1043108"} Jul 07 06:31:30.536831 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:30.536813 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g2qqq" event={"ID":"9bc4126b-dd20-4d97-b66f-09366cc64d3e","Type":"ContainerStarted","Data":"678953e6f6929ea4a315657cc6d78c3cd7a0f888cc1be780ed097e1ae8c2263d"} Jul 07 06:31:31.054155 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:31.054116 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:31.054262 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:31.054199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:31.054371 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.054350 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:31.054478 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.054419 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:31.055237 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.054426 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs podName:bc2b4af1-d047-4ad8-8951-c1a020da2030 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:33.05440615 +0000 UTC m=+6.056485462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs") pod "network-metrics-daemon-ph8qs" (UID: "bc2b4af1-d047-4ad8-8951-c1a020da2030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:31.055339 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.055251 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret podName:cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:33.055234269 +0000 UTC m=+6.057313561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret") pod "global-pull-secret-syncer-zmwbj" (UID: "cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:31.155262 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:31.154579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9nl\" (UniqueName: \"kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl\") pod \"network-check-target-rcpd5\" (UID: \"54902f7d-66fe-49c9-a0e2-70bf30a93765\") " pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:31.155262 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.154746 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:31:31.155262 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.154765 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:31:31.155262 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.154779 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2n9nl for pod openshift-network-diagnostics/network-check-target-rcpd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:31.155262 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.154845 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl podName:54902f7d-66fe-49c9-a0e2-70bf30a93765 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:33.154826466 +0000 UTC m=+6.156905766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2n9nl" (UniqueName: "kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl") pod "network-check-target-rcpd5" (UID: "54902f7d-66fe-49c9-a0e2-70bf30a93765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:31.481360 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:31.481240 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 06:26:29 +0000 UTC" deadline="2027-12-17 12:36:44.428096838 +0000 UTC" Jul 07 06:31:31.481360 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:31.481310 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12678h5m12.946791052s" Jul 07 06:31:31.523797 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:31.523761 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:31.523945 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.523905 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:31.524682 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:31.524343 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:31.524682 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.524463 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:31.524682 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:31.524537 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:31.524682 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:31.524614 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:31.552457 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:31.552418 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" event={"ID":"9178fa6a4c12c534b2a4b3275d3b9775","Type":"ContainerStarted","Data":"887d15b8a20277715a2a22e603dc9afba0b1c23a533b4f4929033467b608cf6e"} Jul 07 06:31:32.562803 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:32.562751 2575 generic.go:356] "Generic (PLEG): container finished" podID="2f2a5517e65a2e6eea49dbce93563b2c" containerID="f70fe69c2b477fe9ab18c2ebe25c2e8895ad58c830b3914e523aebea8aac076d" exitCode=0 Jul 07 06:31:32.563426 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:32.562917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" event={"ID":"2f2a5517e65a2e6eea49dbce93563b2c","Type":"ContainerDied","Data":"f70fe69c2b477fe9ab18c2ebe25c2e8895ad58c830b3914e523aebea8aac076d"} Jul 07 06:31:32.580760 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:32.580697 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" podStartSLOduration=3.580675306 podStartE2EDuration="3.580675306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:31:31.570755132 +0000 UTC m=+4.572834449" watchObservedRunningTime="2026-07-07 06:31:32.580675306 +0000 UTC m=+5.582754623" Jul 07 06:31:33.072666 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:33.072631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:33.072858 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:33.072688 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:33.072858 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.072830 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:33.072979 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.072859 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:33.072979 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.072914 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret podName:cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:37.072890359 +0000 UTC m=+10.074969666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret") pod "global-pull-secret-syncer-zmwbj" (UID: "cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:33.072979 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.072955 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs podName:bc2b4af1-d047-4ad8-8951-c1a020da2030 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:37.072943691 +0000 UTC m=+10.075022990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs") pod "network-metrics-daemon-ph8qs" (UID: "bc2b4af1-d047-4ad8-8951-c1a020da2030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:33.173822 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:33.173786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9nl\" (UniqueName: \"kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl\") pod \"network-check-target-rcpd5\" (UID: \"54902f7d-66fe-49c9-a0e2-70bf30a93765\") " pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:33.174048 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.174025 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:31:33.174114 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.174060 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:31:33.174114 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.174074 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2n9nl for pod openshift-network-diagnostics/network-check-target-rcpd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:33.174244 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.174153 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl podName:54902f7d-66fe-49c9-a0e2-70bf30a93765 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:37.174132093 +0000 UTC m=+10.176211390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2n9nl" (UniqueName: "kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl") pod "network-check-target-rcpd5" (UID: "54902f7d-66fe-49c9-a0e2-70bf30a93765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:33.524521 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:33.523682 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:33.524521 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.523815 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:33.524521 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:33.524200 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:33.524521 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.524291 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:33.524521 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:33.524341 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:33.524521 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:33.524421 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:35.523933 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:35.523891 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:35.524457 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:35.524027 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:35.524518 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:35.524461 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:35.524589 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:35.524568 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:35.524642 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:35.524630 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:35.524726 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:35.524709 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:37.106937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:37.106901 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:37.107403 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:37.106954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:37.107403 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.107047 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:37.107403 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.107127 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:37.107403 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.107134 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret podName:cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:45.107115798 +0000 UTC m=+18.109195103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret") pod "global-pull-secret-syncer-zmwbj" (UID: "cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:37.107403 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.107187 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs podName:bc2b4af1-d047-4ad8-8951-c1a020da2030 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:45.107169893 +0000 UTC m=+18.109249184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs") pod "network-metrics-daemon-ph8qs" (UID: "bc2b4af1-d047-4ad8-8951-c1a020da2030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:37.207785 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:37.207746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9nl\" (UniqueName: \"kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl\") pod \"network-check-target-rcpd5\" (UID: \"54902f7d-66fe-49c9-a0e2-70bf30a93765\") " pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:37.207935 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.207909 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:31:37.207935 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.207932 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:31:37.208046 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.207943 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2n9nl for pod openshift-network-diagnostics/network-check-target-rcpd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:37.208046 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.207998 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl podName:54902f7d-66fe-49c9-a0e2-70bf30a93765 nodeName:}" failed. No retries permitted until 2026-07-07 06:31:45.207982899 +0000 UTC m=+18.210062189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2n9nl" (UniqueName: "kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl") pod "network-check-target-rcpd5" (UID: "54902f7d-66fe-49c9-a0e2-70bf30a93765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:37.522409 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:37.522338 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:37.522701 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.522432 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:37.522701 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:37.522517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:37.522701 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:37.522531 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:37.522701 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.522653 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:37.522929 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:37.522745 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:39.522240 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:39.522206 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:39.522682 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:39.522340 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:39.522682 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:39.522470 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:39.522682 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:39.522569 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:39.522850 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:39.522776 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:39.522903 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:39.522869 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:41.522287 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.522257 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:41.522735 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.522257 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:41.522735 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:41.522350 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:41.522735 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:41.522450 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:41.522735 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.522264 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:41.522735 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:41.522542 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:41.583841 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.583462 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drc6p" event={"ID":"90d97f41-cf09-4bde-aab1-b29ab0050234","Type":"ContainerStarted","Data":"0140b8be3d2bb40e4c332b4950359471cb6b0ec6944f15bd108356befd3effb6"} Jul 07 06:31:41.585660 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.585626 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r949v" event={"ID":"39efcee3-3895-4b99-883c-273bba95191b","Type":"ContainerStarted","Data":"40adf1c8379cf07e773d69653682512e7ee3d3fb5ea961d1cc4551f49414baaf"} Jul 07 06:31:41.588601 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.588572 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" event={"ID":"6336a8df-6a20-4970-a22b-79bdbdd9574e","Type":"ContainerStarted","Data":"d92b86350ab931f2fa0d8aa991e9a8cac94281eaa9e3b137a21fc2b39a9f2c6f"} Jul 07 06:31:41.590724 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.590698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" event={"ID":"16ab1acc-1355-4186-b4e0-51fbf6241b3b","Type":"ContainerStarted","Data":"41a7f2bb34e80265b064d10061ed95fdfe9bcbb248a8b45b3a4587c54e93f4ea"} Jul 07 06:31:41.593778 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.593393 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" event={"ID":"2f2a5517e65a2e6eea49dbce93563b2c","Type":"ContainerStarted","Data":"f962cb2aefb8bce7ccb1ce561cd9cc9ae1332fadc75de759309465634029463a"} Jul 07 06:31:41.595484 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.595459 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" event={"ID":"29e5136f-635a-4615-9dd8-46155addba05","Type":"ContainerStarted","Data":"e8c30b5eb601244a7fb80b71ccdfa9e6405a6a451477d080f692c0be5960dd08"} Jul 07 06:31:41.597838 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.597817 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j8bqh" event={"ID":"e3b3ec4a-096e-4f79-9637-0a030bbeb608","Type":"ContainerStarted","Data":"b790c005a5cd05de3fc16ebc2d29d349955cc54fb6f8a04d1f74facd2c349660"} Jul 07 06:31:41.616441 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.616388 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-drc6p" podStartSLOduration=2.344381833 podStartE2EDuration="13.616370749s" totalImagesPullingTime="11.271988916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:31:41.599392155 +0000 UTC m=+14.601471467" watchObservedRunningTime="2026-07-07 06:31:41.616370749 +0000 UTC m=+14.618450063" Jul 07 06:31:41.630207 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.630170 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pgjmx" podStartSLOduration=2.139958249 podStartE2EDuration="13.630137925s" totalImagesPullingTime="11.490179676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:31:41.616085994 +0000 UTC m=+14.618165303" watchObservedRunningTime="2026-07-07 06:31:41.630137925 +0000 UTC m=+14.632217238" Jul 07 06:31:41.630327 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.630307 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" podStartSLOduration=12.630300283 podStartE2EDuration="12.630300283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:31:41.630012298 +0000 UTC m=+14.632091611" watchObservedRunningTime="2026-07-07 06:31:41.630300283 +0000 UTC m=+14.632379597" Jul 07 06:31:41.645161 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.645125 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r949v" podStartSLOduration=2.366923351 podStartE2EDuration="13.645112765s" totalImagesPullingTime="11.278189414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:31:41.644979586 +0000 UTC m=+14.647058913" watchObservedRunningTime="2026-07-07 06:31:41.645112765 +0000 UTC m=+14.647192071" Jul 07 06:31:41.688164 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:41.688060 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j8bqh" podStartSLOduration=2.400747921 podStartE2EDuration="13.688047489s" totalImagesPullingTime="11.287299568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:31:41.688036037 +0000 UTC m=+14.690115350" watchObservedRunningTime="2026-07-07 06:31:41.688047489 +0000 UTC m=+14.690126802" Jul 07 06:31:42.602168 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:42.602134 2575 generic.go:356] "Generic (PLEG): container finished" podID="16ab1acc-1355-4186-b4e0-51fbf6241b3b" containerID="41a7f2bb34e80265b064d10061ed95fdfe9bcbb248a8b45b3a4587c54e93f4ea" exitCode=0 Jul 07 06:31:42.602748 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:42.602260 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" event={"ID":"16ab1acc-1355-4186-b4e0-51fbf6241b3b","Type":"ContainerDied","Data":"41a7f2bb34e80265b064d10061ed95fdfe9bcbb248a8b45b3a4587c54e93f4ea"} Jul 07 06:31:43.522233 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:43.522195 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:43.522414 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:43.522264 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:43.522414 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:43.522268 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:43.522414 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:43.522352 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:43.522723 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:43.522688 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:43.522829 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:43.522782 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:43.605882 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:43.605852 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g2qqq" event={"ID":"9bc4126b-dd20-4d97-b66f-09366cc64d3e","Type":"ContainerStarted","Data":"d933d54dd523b17ae993372302b514d2e61e4d37e63ef431962d099f99d61209"} Jul 07 06:31:43.624171 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:43.624126 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g2qqq" podStartSLOduration=4.306884445 podStartE2EDuration="15.624110995s" totalImagesPullingTime="11.31722655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:31:43.623713273 +0000 UTC m=+16.625792590" watchObservedRunningTime="2026-07-07 06:31:43.624110995 +0000 UTC m=+16.626190311" Jul 07 06:31:43.983392 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:43.982983 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:43.983719 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:43.983694 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:45.168196 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:45.168158 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:45.168755 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:45.168217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:45.168755 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.168295 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:45.168755 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.168344 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:45.168755 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.168362 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret podName:cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:01.168346915 +0000 UTC m=+34.170426211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret") pod "global-pull-secret-syncer-zmwbj" (UID: "cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:31:45.168755 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.168403 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs podName:bc2b4af1-d047-4ad8-8951-c1a020da2030 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:01.168386442 +0000 UTC m=+34.170465737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs") pod "network-metrics-daemon-ph8qs" (UID: "bc2b4af1-d047-4ad8-8951-c1a020da2030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:31:45.269518 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:45.269483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9nl\" (UniqueName: \"kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl\") pod \"network-check-target-rcpd5\" (UID: \"54902f7d-66fe-49c9-a0e2-70bf30a93765\") " pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:45.269706 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.269619 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:31:45.269706 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.269636 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:31:45.269706 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.269645 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2n9nl for pod openshift-network-diagnostics/network-check-target-rcpd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:45.269832 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.269707 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl podName:54902f7d-66fe-49c9-a0e2-70bf30a93765 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:01.269688306 +0000 UTC m=+34.271767598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2n9nl" (UniqueName: "kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl") pod "network-check-target-rcpd5" (UID: "54902f7d-66fe-49c9-a0e2-70bf30a93765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:31:45.521161 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:45.521082 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:45.521322 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:45.521087 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:45.521322 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:45.521209 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:45.521322 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.521205 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:45.521322 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.521308 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:45.521529 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:45.521390 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:47.522330 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:47.522095 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:47.522762 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:47.522187 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:47.522762 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:47.522386 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:47.522762 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:47.522237 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:47.522762 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:47.522466 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:47.522762 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:47.522525 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:49.521988 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:49.521960 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:49.522427 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:49.522086 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:49.522497 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:49.522448 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:49.522554 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:49.522538 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:49.522599 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:49.522582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:49.522645 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:49.522628 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:49.763147 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:49.763109 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:49.763404 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:49.763254 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 06:31:49.763886 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:49.763864 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-drc6p" Jul 07 06:31:51.061621 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.061571 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 06:31:51.506387 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.506027 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T06:31:51.061593658Z","UUID":"4b3548fa-3849-4245-a7fc-d4c9c14a6490","Handler":null,"Name":"","Endpoint":""} Jul 07 06:31:51.507847 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.507829 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 06:31:51.507936 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.507868 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 06:31:51.521322 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.521296 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:51.521431 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.521296 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:51.521431 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:51.521382 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:51.521500 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:51.521452 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:51.521500 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.521494 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:51.521568 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:51.521546 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:51.627110 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.627049 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" event={"ID":"c02539c3-5803-4598-9bae-d4f89bd37a53","Type":"ContainerStarted","Data":"70230ef04efe2dd40451b12cbbe0a87132fec950ef78baa8e466f8a14d820e10"} Jul 07 06:31:51.627301 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.627165 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" event={"ID":"c02539c3-5803-4598-9bae-d4f89bd37a53","Type":"ContainerStarted","Data":"441781b13bb0b307210b430c9bea0176cc49ef977be2417e09c8bbd95a4a4396"} Jul 07 06:31:51.627301 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.627197 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" event={"ID":"c02539c3-5803-4598-9bae-d4f89bd37a53","Type":"ContainerStarted","Data":"d8bfb726802a465e3ef9e4c105c0c6e7a7432a6a73c396340a4e35b64e9c3724"} Jul 07 06:31:51.627301 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.627226 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" event={"ID":"c02539c3-5803-4598-9bae-d4f89bd37a53","Type":"ContainerStarted","Data":"5d5a7def93b0bba3be629478a0aa57180edd8a90d01097d97584e005f49f5fd0"} Jul 07 06:31:51.627301 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.627254 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" event={"ID":"c02539c3-5803-4598-9bae-d4f89bd37a53","Type":"ContainerStarted","Data":"b768c5652937d35f897e3bf0f37e78e0e6e9bbb7fb4f5c32a9ac37e74af6a450"} Jul 07 06:31:51.627301 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.627283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" event={"ID":"c02539c3-5803-4598-9bae-d4f89bd37a53","Type":"ContainerStarted","Data":"7ff226c454064415aef78cd0879f0f6d0e766700aec1ca85f4fd4d3e74130a05"} Jul 07 06:31:51.628773 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.628745 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pqq72" event={"ID":"0e5527f6-1a0f-477a-8f94-b91c8f810269","Type":"ContainerStarted","Data":"292080f076dcaababd0b2e549fe69d7fb390753fe45c4269832d4adf618c1e64"} Jul 07 06:31:51.630781 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.630759 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" event={"ID":"6336a8df-6a20-4970-a22b-79bdbdd9574e","Type":"ContainerStarted","Data":"c033d18dc59abbde1f5f3a676a27f0bdbc09810cfb2753437bda25b4b3f3e4e6"} Jul 07 06:31:51.645810 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:51.645759 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pqq72" podStartSLOduration=2.442531639 podStartE2EDuration="23.645741034s" totalImagesPullingTime="21.203209395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:31:51.645430262 +0000 UTC m=+24.647509580" watchObservedRunningTime="2026-07-07 06:31:51.645741034 +0000 UTC m=+24.647820349" Jul 07 06:31:52.634639 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:52.634607 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" event={"ID":"6336a8df-6a20-4970-a22b-79bdbdd9574e","Type":"ContainerStarted","Data":"ee29fbda2d64c58dba28a8c49f231fce62c1e150944c9517a8c567d18fa5ea09"} Jul 07 06:31:52.654268 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:52.654223 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9fv2s" podStartSLOduration=2.573987189 podStartE2EDuration="24.654210772s" totalImagesPullingTime="22.080223583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:31:52.653685831 +0000 UTC m=+25.655765125" watchObservedRunningTime="2026-07-07 06:31:52.654210772 +0000 UTC m=+25.656290115" Jul 07 06:31:53.521802 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:53.521778 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:53.521904 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:53.521782 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:53.521904 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:53.521897 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:53.522014 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:53.521890 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:53.522088 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:53.522021 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:53.522148 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:53.522110 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:53.640960 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:53.640924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" event={"ID":"c02539c3-5803-4598-9bae-d4f89bd37a53","Type":"ContainerStarted","Data":"cb160a318701f82011e05d6d0ebbd4261b84f9a5e1cbccd2bc172369a8bfc225"} Jul 07 06:31:55.521398 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:55.521359 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:55.521398 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:55.521387 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:55.521918 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:55.521464 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:55.521918 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:55.521811 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:55.521918 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:55.521850 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:55.521918 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:55.521909 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:56.652102 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:56.651852 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" event={"ID":"c02539c3-5803-4598-9bae-d4f89bd37a53","Type":"ContainerStarted","Data":"35c3222213783556d5b1122988f7319aa231107e4cd8af39c46f5a722e771cd6"} Jul 07 06:31:56.652765 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:56.652192 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:56.652765 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:56.652242 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:56.669464 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:56.669437 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:56.687657 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:56.687617 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" podStartSLOduration=7.489151597 podStartE2EDuration="28.687603025s" totalImagesPullingTime="21.198451428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:31:56.687153308 +0000 UTC m=+29.689232630" watchObservedRunningTime="2026-07-07 06:31:56.687603025 +0000 UTC m=+29.689682337" Jul 07 06:31:57.522272 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.522247 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:57.522418 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.522358 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:57.522486 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:57.522357 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:57.522537 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.522488 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:57.522584 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:57.522484 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:57.522632 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:57.522576 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:57.655804 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.655778 2575 generic.go:356] "Generic (PLEG): container finished" podID="16ab1acc-1355-4186-b4e0-51fbf6241b3b" containerID="de195a0919fbdbf4891922edd5874e3c2b8ca76510b950b6009414ebcf50c6be" exitCode=0 Jul 07 06:31:57.656212 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.655853 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" event={"ID":"16ab1acc-1355-4186-b4e0-51fbf6241b3b","Type":"ContainerDied","Data":"de195a0919fbdbf4891922edd5874e3c2b8ca76510b950b6009414ebcf50c6be"} Jul 07 06:31:57.656381 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.656361 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:57.672098 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.672057 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:31:57.854652 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.854626 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zmwbj"] Jul 07 06:31:57.854807 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.854735 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:57.854870 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:57.854845 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:57.855255 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.855236 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ph8qs"] Jul 07 06:31:57.855331 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.855321 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:57.855407 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:57.855391 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:57.859011 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.858987 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rcpd5"] Jul 07 06:31:57.859107 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:57.859057 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:57.859145 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:57.859132 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:59.521571 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:59.521540 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:31:59.521571 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:59.521556 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:31:59.522129 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:59.521543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:31:59.522129 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:59.521640 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:31:59.522129 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:59.521702 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:31:59.522129 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:31:59.521766 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:31:59.663051 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:59.663026 2575 generic.go:356] "Generic (PLEG): container finished" podID="16ab1acc-1355-4186-b4e0-51fbf6241b3b" containerID="6be8242459eebf90aafecc568bde5d570f4c4f80241357c97e6112cc9cf47a2e" exitCode=0 Jul 07 06:31:59.663185 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:31:59.663156 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" event={"ID":"16ab1acc-1355-4186-b4e0-51fbf6241b3b","Type":"ContainerDied","Data":"6be8242459eebf90aafecc568bde5d570f4c4f80241357c97e6112cc9cf47a2e"} Jul 07 06:32:01.184734 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:01.184559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:32:01.185183 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:01.184747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:32:01.185183 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.184699 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:32:01.185183 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.184845 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:32:01.185183 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.184857 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret podName:cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:33.184841067 +0000 UTC m=+66.186920359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret") pod "global-pull-secret-syncer-zmwbj" (UID: "cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:32:01.185183 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.184884 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs podName:bc2b4af1-d047-4ad8-8951-c1a020da2030 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:33.184873323 +0000 UTC m=+66.186952614 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs") pod "network-metrics-daemon-ph8qs" (UID: "bc2b4af1-d047-4ad8-8951-c1a020da2030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:32:01.285493 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:01.285460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9nl\" (UniqueName: \"kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl\") pod \"network-check-target-rcpd5\" (UID: \"54902f7d-66fe-49c9-a0e2-70bf30a93765\") " pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:32:01.285634 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.285577 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:32:01.285634 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.285590 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:32:01.285634 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.285598 2575 projected.go:196] Error preparing data for projected volume kube-api-access-2n9nl for pod openshift-network-diagnostics/network-check-target-rcpd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:32:01.285739 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.285642 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl podName:54902f7d-66fe-49c9-a0e2-70bf30a93765 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:33.285630634 +0000 UTC m=+66.287709925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2n9nl" (UniqueName: "kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl") pod "network-check-target-rcpd5" (UID: "54902f7d-66fe-49c9-a0e2-70bf30a93765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:32:01.521781 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:01.521706 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:32:01.521930 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:01.521706 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:32:01.521930 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:01.521825 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:32:01.521930 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.521827 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:32:01.521930 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.521892 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:32:01.522146 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:01.521971 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:32:01.669626 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:01.669600 2575 generic.go:356] "Generic (PLEG): container finished" podID="16ab1acc-1355-4186-b4e0-51fbf6241b3b" containerID="2a1d6b99f6ef67e8f331354f5928434d99299fe6d73d73d531d45c1e067b60a5" exitCode=0 Jul 07 06:32:01.669756 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:01.669651 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" event={"ID":"16ab1acc-1355-4186-b4e0-51fbf6241b3b","Type":"ContainerDied","Data":"2a1d6b99f6ef67e8f331354f5928434d99299fe6d73d73d531d45c1e067b60a5"} Jul 07 06:32:03.521866 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.521827 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:32:03.521866 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.521861 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:32:03.522411 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.521827 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:32:03.522411 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:03.522028 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ph8qs" podUID="bc2b4af1-d047-4ad8-8951-c1a020da2030" Jul 07 06:32:03.522411 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:03.521954 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zmwbj" podUID="cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3" Jul 07 06:32:03.522411 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:03.522131 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcpd5" podUID="54902f7d-66fe-49c9-a0e2-70bf30a93765" Jul 07 06:32:03.792016 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.791988 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeReady" Jul 07 06:32:03.792177 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.792112 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 06:32:03.832106 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.832059 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7998b6489d-pmxvc"] Jul 07 06:32:03.836546 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.836523 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:03.841458 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.841437 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 06:32:03.841572 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.841464 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 06:32:03.841634 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.841598 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-htvtq\"" Jul 07 06:32:03.841695 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.841686 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 06:32:03.849522 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.849506 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 06:32:03.852102 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.852059 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7998b6489d-pmxvc"] Jul 07 06:32:03.856747 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.856725 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l6pcn"] Jul 07 06:32:03.859764 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.859747 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jsbmz"] Jul 07 06:32:03.859896 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.859878 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:03.862785 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.862768 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jsbmz" Jul 07 06:32:03.863003 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.862983 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lfbmp\"" Jul 07 06:32:03.863132 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.862991 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 06:32:03.863132 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.863131 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 06:32:03.866171 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.865879 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bdntf\"" Jul 07 06:32:03.866171 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.866032 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 06:32:03.866171 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.866052 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 06:32:03.866171 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.866138 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 06:32:03.872106 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.872066 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l6pcn"] Jul 07 06:32:03.890911 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:03.890890 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jsbmz"] Jul 07 06:32:04.005510 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-certificates\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.005510 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-bound-sa-token\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.005732 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/699518c9-70c1-42fa-aae5-14b0a24dc49a-ca-trust-extracted\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.005732 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd8c291f-b8db-4725-97fd-cbb92e48d483-tmp-dir\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.005732 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005636 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmxr2\" (UniqueName: \"kubernetes.io/projected/d3e1680c-1cc4-4edc-9548-d925aacfe2de-kube-api-access-nmxr2\") pod \"ingress-canary-jsbmz\" (UID: \"d3e1680c-1cc4-4edc-9548-d925aacfe2de\") " pod="openshift-ingress-canary/ingress-canary-jsbmz" Jul 07 06:32:04.005732 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.005732 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-trusted-ca\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.005942 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005743 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87frp\" (UniqueName: \"kubernetes.io/projected/fd8c291f-b8db-4725-97fd-cbb92e48d483-kube-api-access-87frp\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.005942 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3e1680c-1cc4-4edc-9548-d925aacfe2de-cert\") pod \"ingress-canary-jsbmz\" (UID: \"d3e1680c-1cc4-4edc-9548-d925aacfe2de\") " pod="openshift-ingress-canary/ingress-canary-jsbmz" Jul 07 06:32:04.005942 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-image-registry-private-configuration\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.005942 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-installation-pull-secrets\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.005942 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005834 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd8c291f-b8db-4725-97fd-cbb92e48d483-config-volume\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.005942 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005887 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.006191 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.005948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45wv\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-kube-api-access-c45wv\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.106277 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd8c291f-b8db-4725-97fd-cbb92e48d483-config-volume\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.106277 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.106277 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45wv\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-kube-api-access-c45wv\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.106527 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-certificates\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.106527 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106319 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-bound-sa-token\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.106527 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:04.106384 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:32:04.106527 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106434 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/699518c9-70c1-42fa-aae5-14b0a24dc49a-ca-trust-extracted\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.106527 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:04.106449 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls podName:fd8c291f-b8db-4725-97fd-cbb92e48d483 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:04.60642801 +0000 UTC m=+37.608507303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls") pod "dns-default-l6pcn" (UID: "fd8c291f-b8db-4725-97fd-cbb92e48d483") : secret "dns-default-metrics-tls" not found Jul 07 06:32:04.106527 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd8c291f-b8db-4725-97fd-cbb92e48d483-tmp-dir\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106529 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmxr2\" (UniqueName: \"kubernetes.io/projected/d3e1680c-1cc4-4edc-9548-d925aacfe2de-kube-api-access-nmxr2\") pod \"ingress-canary-jsbmz\" (UID: \"d3e1680c-1cc4-4edc-9548-d925aacfe2de\") " pod="openshift-ingress-canary/ingress-canary-jsbmz" Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106598 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-trusted-ca\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87frp\" (UniqueName: \"kubernetes.io/projected/fd8c291f-b8db-4725-97fd-cbb92e48d483-kube-api-access-87frp\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3e1680c-1cc4-4edc-9548-d925aacfe2de-cert\") pod \"ingress-canary-jsbmz\" (UID: \"d3e1680c-1cc4-4edc-9548-d925aacfe2de\") " pod="openshift-ingress-canary/ingress-canary-jsbmz" Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106674 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-image-registry-private-configuration\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:04.106699 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:04.106717 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7998b6489d-pmxvc: secret "image-registry-tls" not found Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:04.106776 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls podName:699518c9-70c1-42fa-aae5-14b0a24dc49a nodeName:}" failed. No retries permitted until 2026-07-07 06:32:04.606757272 +0000 UTC m=+37.608836565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls") pod "image-registry-7998b6489d-pmxvc" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a") : secret "image-registry-tls" not found Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106702 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-installation-pull-secrets\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.106866 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106816 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd8c291f-b8db-4725-97fd-cbb92e48d483-tmp-dir\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.107417 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.106977 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-certificates\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.107417 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.107016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/699518c9-70c1-42fa-aae5-14b0a24dc49a-ca-trust-extracted\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.107740 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.107656 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-trusted-ca\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.107740 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.107692 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd8c291f-b8db-4725-97fd-cbb92e48d483-config-volume\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.112153 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.112127 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-image-registry-private-configuration\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.112153 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.112147 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-installation-pull-secrets\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.112326 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.112204 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3e1680c-1cc4-4edc-9548-d925aacfe2de-cert\") pod \"ingress-canary-jsbmz\" (UID: \"d3e1680c-1cc4-4edc-9548-d925aacfe2de\") " pod="openshift-ingress-canary/ingress-canary-jsbmz" Jul 07 06:32:04.115813 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.115791 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmxr2\" (UniqueName: \"kubernetes.io/projected/d3e1680c-1cc4-4edc-9548-d925aacfe2de-kube-api-access-nmxr2\") pod \"ingress-canary-jsbmz\" (UID: \"d3e1680c-1cc4-4edc-9548-d925aacfe2de\") " pod="openshift-ingress-canary/ingress-canary-jsbmz" Jul 07 06:32:04.116420 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.116322 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-bound-sa-token\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.116420 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.116379 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45wv\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-kube-api-access-c45wv\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.116572 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.116549 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87frp\" (UniqueName: \"kubernetes.io/projected/fd8c291f-b8db-4725-97fd-cbb92e48d483-kube-api-access-87frp\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.178899 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.178867 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jsbmz" Jul 07 06:32:04.372124 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.371910 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jsbmz"] Jul 07 06:32:04.377115 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:04.377085 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e1680c_1cc4_4edc_9548_d925aacfe2de.slice/crio-72769b7d9f409e2e18ac65aec4f6eefb1100450d15ff1a95de59d12398eb40ae WatchSource:0}: Error finding container 72769b7d9f409e2e18ac65aec4f6eefb1100450d15ff1a95de59d12398eb40ae: Status 404 returned error can't find the container with id 72769b7d9f409e2e18ac65aec4f6eefb1100450d15ff1a95de59d12398eb40ae Jul 07 06:32:04.610857 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.610820 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:04.611450 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.610881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:04.611450 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:04.610978 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:32:04.611450 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:04.610993 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7998b6489d-pmxvc: secret "image-registry-tls" not found Jul 07 06:32:04.611450 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:04.610994 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:32:04.611450 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:04.611090 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls podName:699518c9-70c1-42fa-aae5-14b0a24dc49a nodeName:}" failed. No retries permitted until 2026-07-07 06:32:05.611054828 +0000 UTC m=+38.613134134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls") pod "image-registry-7998b6489d-pmxvc" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a") : secret "image-registry-tls" not found Jul 07 06:32:04.611450 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:04.611145 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls podName:fd8c291f-b8db-4725-97fd-cbb92e48d483 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:05.611115146 +0000 UTC m=+38.613194459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls") pod "dns-default-l6pcn" (UID: "fd8c291f-b8db-4725-97fd-cbb92e48d483") : secret "dns-default-metrics-tls" not found Jul 07 06:32:04.677039 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:04.676924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jsbmz" event={"ID":"d3e1680c-1cc4-4edc-9548-d925aacfe2de","Type":"ContainerStarted","Data":"72769b7d9f409e2e18ac65aec4f6eefb1100450d15ff1a95de59d12398eb40ae"} Jul 07 06:32:05.522586 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.521917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:32:05.522586 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.521917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:32:05.522586 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.522061 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:32:05.524763 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.524742 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 06:32:05.526055 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.526038 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 06:32:05.526192 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.526171 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wsxr\"" Jul 07 06:32:05.526314 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.526297 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 06:32:05.526559 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.526539 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 06:32:05.526665 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.526587 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dsscv\"" Jul 07 06:32:05.618985 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.618949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:05.619429 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.619010 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:05.619429 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:05.619221 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:32:05.619429 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:05.619284 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls podName:fd8c291f-b8db-4725-97fd-cbb92e48d483 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:07.619264866 +0000 UTC m=+40.621344160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls") pod "dns-default-l6pcn" (UID: "fd8c291f-b8db-4725-97fd-cbb92e48d483") : secret "dns-default-metrics-tls" not found Jul 07 06:32:05.619429 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:05.619355 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:32:05.619429 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:05.619366 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7998b6489d-pmxvc: secret "image-registry-tls" not found Jul 07 06:32:05.619429 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:05.619398 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls podName:699518c9-70c1-42fa-aae5-14b0a24dc49a nodeName:}" failed. No retries permitted until 2026-07-07 06:32:07.619387923 +0000 UTC m=+40.621467216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls") pod "image-registry-7998b6489d-pmxvc" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a") : secret "image-registry-tls" not found Jul 07 06:32:05.680419 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.680384 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:05.783880 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.783749 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:05.846543 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.846513 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:05.912193 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:05.912160 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:06.014001 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:06.013968 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:06.407291 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:06.407257 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:06.467776 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:06.467744 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:06.809497 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:06.809462 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:06.868010 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:06.867972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:07.618606 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:07.618517 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:07.635482 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:07.635452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:07.635595 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:07.635491 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:07.635595 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:07.635581 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:32:07.635595 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:07.635584 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:32:07.635755 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:07.635599 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7998b6489d-pmxvc: secret "image-registry-tls" not found Jul 07 06:32:07.635755 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:07.635627 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls podName:fd8c291f-b8db-4725-97fd-cbb92e48d483 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:11.635614151 +0000 UTC m=+44.637693442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls") pod "dns-default-l6pcn" (UID: "fd8c291f-b8db-4725-97fd-cbb92e48d483") : secret "dns-default-metrics-tls" not found Jul 07 06:32:07.635755 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:07.635644 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls podName:699518c9-70c1-42fa-aae5-14b0a24dc49a nodeName:}" failed. No retries permitted until 2026-07-07 06:32:11.63563333 +0000 UTC m=+44.637712620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls") pod "image-registry-7998b6489d-pmxvc" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a") : secret "image-registry-tls" not found Jul 07 06:32:08.010739 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:08.010700 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:08.065362 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:08.065329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:08.688893 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:08.688858 2575 generic.go:356] "Generic (PLEG): container finished" podID="16ab1acc-1355-4186-b4e0-51fbf6241b3b" containerID="de4cfde3b04a67620c7415b2459a56ee03968db0c4012bf124ddf8b4e51cf86b" exitCode=0 Jul 07 06:32:08.689061 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:08.688940 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" event={"ID":"16ab1acc-1355-4186-b4e0-51fbf6241b3b","Type":"ContainerDied","Data":"de4cfde3b04a67620c7415b2459a56ee03968db0c4012bf124ddf8b4e51cf86b"} Jul 07 06:32:08.690509 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:08.690487 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jsbmz" event={"ID":"d3e1680c-1cc4-4edc-9548-d925aacfe2de","Type":"ContainerStarted","Data":"4ca83068484a180870f19ed77c12cbd421b09ad1a92dbf85ccc4957d5117ed6c"} Jul 07 06:32:09.081024 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.080941 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jsbmz" podStartSLOduration=2.628334947 podStartE2EDuration="6.080922856s" totalImagesPullingTime="3.452587909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:08.729488767 +0000 UTC m=+41.731568081" watchObservedRunningTime="2026-07-07 06:32:09.080922856 +0000 UTC m=+42.083002169" Jul 07 06:32:09.081430 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.081098 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q"] Jul 07 06:32:09.097267 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.097228 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2"] Jul 07 06:32:09.097267 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.097254 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q" Jul 07 06:32:09.100296 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.100276 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qc4n5\"" Jul 07 06:32:09.100296 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.100289 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:32:09.100461 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.100310 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 06:32:09.110959 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.110944 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q"] Jul 07 06:32:09.111033 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.110969 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2"] Jul 07 06:32:09.111083 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.111044 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:09.114150 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.113975 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 06:32:09.114150 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.114039 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:32:09.114301 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.114155 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 06:32:09.114371 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.114344 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cgz52\"" Jul 07 06:32:09.175950 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.175924 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f"] Jul 07 06:32:09.197220 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.197200 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f"] Jul 07 06:32:09.197309 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.197230 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv"] Jul 07 06:32:09.197342 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.197308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f" Jul 07 06:32:09.200427 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.200398 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-t4trl\"" Jul 07 06:32:09.219114 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.219093 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2"] Jul 07 06:32:09.219223 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.219171 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.221956 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.221936 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 06:32:09.222051 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.221965 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:32:09.222051 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.221985 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 06:32:09.222051 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.221966 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 06:32:09.222236 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.222067 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bvs22\"" Jul 07 06:32:09.241376 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.241356 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq"] Jul 07 06:32:09.241488 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.241473 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:09.244395 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.244373 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 06:32:09.244395 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.244384 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t9g8g\"" Jul 07 06:32:09.244395 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.244394 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 06:32:09.244566 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.244380 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 06:32:09.245216 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.245203 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 06:32:09.249096 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.248190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zql9j\" (UniqueName: \"kubernetes.io/projected/23d1165d-f14c-4f68-a463-ee69c76007d0-kube-api-access-zql9j\") pod \"volume-data-source-validator-5d456fdbcd-fvl2q\" (UID: \"23d1165d-f14c-4f68-a463-ee69c76007d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q" Jul 07 06:32:09.249096 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.248226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w69j9\" (UniqueName: \"kubernetes.io/projected/9c732e64-7ccf-4c35-9719-32311c3aba35-kube-api-access-w69j9\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:09.249096 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.248347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:09.261415 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.261394 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv"] Jul 07 06:32:09.261498 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.261421 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq"] Jul 07 06:32:09.261498 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.261434 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2"] Jul 07 06:32:09.261570 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.261500 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.264196 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.264166 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 06:32:09.264196 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.264193 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:32:09.264337 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.264169 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 06:32:09.264337 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.264169 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 06:32:09.264337 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.264169 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-x59df\"" Jul 07 06:32:09.282797 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.282779 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-2rvvr"] Jul 07 06:32:09.303540 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.303523 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-cnh47"] Jul 07 06:32:09.303662 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.303647 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.306158 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.306136 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-r6zbm\"" Jul 07 06:32:09.306158 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.306146 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 06:32:09.306322 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.306243 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 06:32:09.306322 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.306266 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 06:32:09.306439 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.306376 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 06:32:09.311043 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.311027 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 06:32:09.327653 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.327634 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9cd96565c-krjmm"] Jul 07 06:32:09.327770 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.327755 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.330255 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.330236 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 06:32:09.330320 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.330256 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 06:32:09.330320 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.330262 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 06:32:09.330320 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.330266 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:32:09.330462 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.330440 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-npmpb\"" Jul 07 06:32:09.336434 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.336417 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 06:32:09.349594 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.349572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edc8cd7b-bac4-4871-a061-95d3a0677d82-config\") pod \"service-ca-operator-5d46d9ffd4-phhwv\" (UID: \"edc8cd7b-bac4-4871-a061-95d3a0677d82\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.349711 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.349625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:09.349711 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.349646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edc8cd7b-bac4-4871-a061-95d3a0677d82-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-phhwv\" (UID: \"edc8cd7b-bac4-4871-a061-95d3a0677d82\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.349711 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.349691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:09.349835 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.349724 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 06:32:09.349835 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.349785 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls podName:9c732e64-7ccf-4c35-9719-32311c3aba35 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:09.849772782 +0000 UTC m=+42.851852073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wbwx2" (UID: "9c732e64-7ccf-4c35-9719-32311c3aba35") : secret "samples-operator-tls" not found Jul 07 06:32:09.349835 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.349798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/45c8dce0-8403-463a-80bf-e6a7c6dceed2-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:09.349835 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.349826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gwbm\" (UniqueName: \"kubernetes.io/projected/45c8dce0-8403-463a-80bf-e6a7c6dceed2-kube-api-access-4gwbm\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:09.350029 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.349883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2gwf\" (UniqueName: \"kubernetes.io/projected/edc8cd7b-bac4-4871-a061-95d3a0677d82-kube-api-access-v2gwf\") pod \"service-ca-operator-5d46d9ffd4-phhwv\" (UID: \"edc8cd7b-bac4-4871-a061-95d3a0677d82\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.350029 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.349918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hr8n\" (UniqueName: \"kubernetes.io/projected/38f31e75-dc86-4540-8f5f-1b97975cd15c-kube-api-access-9hr8n\") pod \"network-check-source-989f8b8dc-wxf7f\" (UID: \"38f31e75-dc86-4540-8f5f-1b97975cd15c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f" Jul 07 06:32:09.350029 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.349980 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zql9j\" (UniqueName: \"kubernetes.io/projected/23d1165d-f14c-4f68-a463-ee69c76007d0-kube-api-access-zql9j\") pod \"volume-data-source-validator-5d456fdbcd-fvl2q\" (UID: \"23d1165d-f14c-4f68-a463-ee69c76007d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q" Jul 07 06:32:09.350029 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.350004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w69j9\" (UniqueName: \"kubernetes.io/projected/9c732e64-7ccf-4c35-9719-32311c3aba35-kube-api-access-w69j9\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:09.351794 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.351779 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-2rvvr"] Jul 07 06:32:09.351843 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.351804 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-cnh47"] Jul 07 06:32:09.351843 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.351818 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9cd96565c-krjmm"] Jul 07 06:32:09.351936 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.351908 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.354340 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.354320 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 06:32:09.354443 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.354360 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 06:32:09.354550 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.354536 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 06:32:09.354588 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.354578 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 06:32:09.354756 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.354735 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 06:32:09.354820 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.354765 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jrzvv\"" Jul 07 06:32:09.357475 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.357454 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 06:32:09.361126 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.361008 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zql9j\" (UniqueName: \"kubernetes.io/projected/23d1165d-f14c-4f68-a463-ee69c76007d0-kube-api-access-zql9j\") pod \"volume-data-source-validator-5d456fdbcd-fvl2q\" (UID: \"23d1165d-f14c-4f68-a463-ee69c76007d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q" Jul 07 06:32:09.361192 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.361010 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w69j9\" (UniqueName: \"kubernetes.io/projected/9c732e64-7ccf-4c35-9719-32311c3aba35-kube-api-access-w69j9\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:09.406136 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.406087 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q" Jul 07 06:32:09.416474 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.416444 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:09.450322 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gwbm\" (UniqueName: \"kubernetes.io/projected/45c8dce0-8403-463a-80bf-e6a7c6dceed2-kube-api-access-4gwbm\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:09.450416 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450332 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j9tx\" (UniqueName: \"kubernetes.io/projected/afb4af7c-3cca-4635-afde-dbb8e92d2664-kube-api-access-7j9tx\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.450416 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450351 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.450496 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450439 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hr8n\" (UniqueName: \"kubernetes.io/projected/38f31e75-dc86-4540-8f5f-1b97975cd15c-kube-api-access-9hr8n\") pod \"network-check-source-989f8b8dc-wxf7f\" (UID: \"38f31e75-dc86-4540-8f5f-1b97975cd15c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f" Jul 07 06:32:09.450496 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-default-certificate\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.450577 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f61f4023-948b-4a84-86a9-0ec309718b46-config\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.450577 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450536 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0cf7c7a-b953-48f5-9e11-a579660d707f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kdbpq\" (UID: \"f0cf7c7a-b953-48f5-9e11-a579660d707f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.450654 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edc8cd7b-bac4-4871-a061-95d3a0677d82-config\") pod \"service-ca-operator-5d46d9ffd4-phhwv\" (UID: \"edc8cd7b-bac4-4871-a061-95d3a0677d82\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.450751 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afb4af7c-3cca-4635-afde-dbb8e92d2664-tmp\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.450791 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r822m\" (UniqueName: \"kubernetes.io/projected/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-kube-api-access-r822m\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.450840 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450808 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f61f4023-948b-4a84-86a9-0ec309718b46-trusted-ca\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.450873 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rctjn\" (UniqueName: \"kubernetes.io/projected/f61f4023-948b-4a84-86a9-0ec309718b46-kube-api-access-rctjn\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.450873 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0cf7c7a-b953-48f5-9e11-a579660d707f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kdbpq\" (UID: \"f0cf7c7a-b953-48f5-9e11-a579660d707f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.450962 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edc8cd7b-bac4-4871-a061-95d3a0677d82-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-phhwv\" (UID: \"edc8cd7b-bac4-4871-a061-95d3a0677d82\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.450962 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7tpv\" (UniqueName: \"kubernetes.io/projected/f0cf7c7a-b953-48f5-9e11-a579660d707f-kube-api-access-c7tpv\") pod \"kube-storage-version-migrator-operator-846bf668f7-kdbpq\" (UID: \"f0cf7c7a-b953-48f5-9e11-a579660d707f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.450962 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.450958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/afb4af7c-3cca-4635-afde-dbb8e92d2664-snapshots\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.451123 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/45c8dce0-8403-463a-80bf-e6a7c6dceed2-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:09.451123 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb4af7c-3cca-4635-afde-dbb8e92d2664-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.451212 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451146 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f61f4023-948b-4a84-86a9-0ec309718b46-serving-cert\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.451212 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451157 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edc8cd7b-bac4-4871-a061-95d3a0677d82-config\") pod \"service-ca-operator-5d46d9ffd4-phhwv\" (UID: \"edc8cd7b-bac4-4871-a061-95d3a0677d82\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.451212 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2gwf\" (UniqueName: \"kubernetes.io/projected/edc8cd7b-bac4-4871-a061-95d3a0677d82-kube-api-access-v2gwf\") pod \"service-ca-operator-5d46d9ffd4-phhwv\" (UID: \"edc8cd7b-bac4-4871-a061-95d3a0677d82\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.451212 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451204 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.451410 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-stats-auth\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.451410 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb4af7c-3cca-4635-afde-dbb8e92d2664-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.451410 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451316 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:09.451410 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451338 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/afb4af7c-3cca-4635-afde-dbb8e92d2664-serving-cert\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.451595 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.451420 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:09.451595 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.451481 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls podName:45c8dce0-8403-463a-80bf-e6a7c6dceed2 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:09.951467564 +0000 UTC m=+42.953546856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4q4s2" (UID: "45c8dce0-8403-463a-80bf-e6a7c6dceed2") : secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:09.451863 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.451663 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/45c8dce0-8403-463a-80bf-e6a7c6dceed2-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:09.453335 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.453316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edc8cd7b-bac4-4871-a061-95d3a0677d82-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-phhwv\" (UID: \"edc8cd7b-bac4-4871-a061-95d3a0677d82\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.460687 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.460669 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hr8n\" (UniqueName: \"kubernetes.io/projected/38f31e75-dc86-4540-8f5f-1b97975cd15c-kube-api-access-9hr8n\") pod \"network-check-source-989f8b8dc-wxf7f\" (UID: \"38f31e75-dc86-4540-8f5f-1b97975cd15c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f" Jul 07 06:32:09.460769 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.460707 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gwbm\" (UniqueName: \"kubernetes.io/projected/45c8dce0-8403-463a-80bf-e6a7c6dceed2-kube-api-access-4gwbm\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:09.461248 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.461231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2gwf\" (UniqueName: \"kubernetes.io/projected/edc8cd7b-bac4-4871-a061-95d3a0677d82-kube-api-access-v2gwf\") pod \"service-ca-operator-5d46d9ffd4-phhwv\" (UID: \"edc8cd7b-bac4-4871-a061-95d3a0677d82\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.505982 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.505952 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f" Jul 07 06:32:09.518192 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.518160 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:09.527165 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.527135 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" Jul 07 06:32:09.551766 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.551737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f61f4023-948b-4a84-86a9-0ec309718b46-serving-cert\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.551887 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.551786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.551887 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.551815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-stats-auth\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.551887 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.551847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb4af7c-3cca-4635-afde-dbb8e92d2664-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.552044 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.551900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/afb4af7c-3cca-4635-afde-dbb8e92d2664-serving-cert\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.552044 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.551931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j9tx\" (UniqueName: \"kubernetes.io/projected/afb4af7c-3cca-4635-afde-dbb8e92d2664-kube-api-access-7j9tx\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.552044 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.551951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.552044 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.551988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-default-certificate\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.552044 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f61f4023-948b-4a84-86a9-0ec309718b46-config\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.552044 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552029 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0cf7c7a-b953-48f5-9e11-a579660d707f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kdbpq\" (UID: \"f0cf7c7a-b953-48f5-9e11-a579660d707f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.552312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afb4af7c-3cca-4635-afde-dbb8e92d2664-tmp\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.552312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r822m\" (UniqueName: \"kubernetes.io/projected/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-kube-api-access-r822m\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.552312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552168 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f61f4023-948b-4a84-86a9-0ec309718b46-trusted-ca\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.552312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rctjn\" (UniqueName: \"kubernetes.io/projected/f61f4023-948b-4a84-86a9-0ec309718b46-kube-api-access-rctjn\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.552312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0cf7c7a-b953-48f5-9e11-a579660d707f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kdbpq\" (UID: \"f0cf7c7a-b953-48f5-9e11-a579660d707f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.552312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552231 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7tpv\" (UniqueName: \"kubernetes.io/projected/f0cf7c7a-b953-48f5-9e11-a579660d707f-kube-api-access-c7tpv\") pod \"kube-storage-version-migrator-operator-846bf668f7-kdbpq\" (UID: \"f0cf7c7a-b953-48f5-9e11-a579660d707f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.552312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552248 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/afb4af7c-3cca-4635-afde-dbb8e92d2664-snapshots\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.552312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb4af7c-3cca-4635-afde-dbb8e92d2664-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.552848 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.552595 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q"] Jul 07 06:32:09.552848 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.552736 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:10.052715403 +0000 UTC m=+43.054794697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : configmap references non-existent config key: service-ca.crt Jul 07 06:32:09.553036 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.553010 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f61f4023-948b-4a84-86a9-0ec309718b46-config\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.553452 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.553360 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f61f4023-948b-4a84-86a9-0ec309718b46-trusted-ca\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.553452 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.553389 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb4af7c-3cca-4635-afde-dbb8e92d2664-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.553626 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.553450 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afb4af7c-3cca-4635-afde-dbb8e92d2664-tmp\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.553801 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.553716 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:32:09.553801 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.553796 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:10.053778732 +0000 UTC m=+43.055858029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : secret "router-metrics-certs-default" not found Jul 07 06:32:09.553992 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.553972 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0cf7c7a-b953-48f5-9e11-a579660d707f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kdbpq\" (UID: \"f0cf7c7a-b953-48f5-9e11-a579660d707f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.554534 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.554410 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb4af7c-3cca-4635-afde-dbb8e92d2664-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.554534 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.554514 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/afb4af7c-3cca-4635-afde-dbb8e92d2664-snapshots\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.555916 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.555891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f61f4023-948b-4a84-86a9-0ec309718b46-serving-cert\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.557216 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.556307 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0cf7c7a-b953-48f5-9e11-a579660d707f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kdbpq\" (UID: \"f0cf7c7a-b953-48f5-9e11-a579660d707f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.557216 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:09.556808 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d1165d_f14c_4f68_a463_ee69c76007d0.slice/crio-74ad9c73b08e3cc923e1fcd5b3950d172ddb4ded87235e07ae6868423b48e69d WatchSource:0}: Error finding container 74ad9c73b08e3cc923e1fcd5b3950d172ddb4ded87235e07ae6868423b48e69d: Status 404 returned error can't find the container with id 74ad9c73b08e3cc923e1fcd5b3950d172ddb4ded87235e07ae6868423b48e69d Jul 07 06:32:09.558312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.557514 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-stats-auth\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.558312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.557782 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-default-certificate\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.558312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.557782 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/afb4af7c-3cca-4635-afde-dbb8e92d2664-serving-cert\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.562710 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.562689 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rctjn\" (UniqueName: \"kubernetes.io/projected/f61f4023-948b-4a84-86a9-0ec309718b46-kube-api-access-rctjn\") pod \"console-operator-68b757fb67-cnh47\" (UID: \"f61f4023-948b-4a84-86a9-0ec309718b46\") " pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.562937 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.562914 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j9tx\" (UniqueName: \"kubernetes.io/projected/afb4af7c-3cca-4635-afde-dbb8e92d2664-kube-api-access-7j9tx\") pod \"insights-operator-5c847dcfc4-2rvvr\" (UID: \"afb4af7c-3cca-4635-afde-dbb8e92d2664\") " pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.563929 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.563897 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7tpv\" (UniqueName: \"kubernetes.io/projected/f0cf7c7a-b953-48f5-9e11-a579660d707f-kube-api-access-c7tpv\") pod \"kube-storage-version-migrator-operator-846bf668f7-kdbpq\" (UID: \"f0cf7c7a-b953-48f5-9e11-a579660d707f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.564359 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.564339 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r822m\" (UniqueName: \"kubernetes.io/projected/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-kube-api-access-r822m\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:09.569307 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.569278 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" Jul 07 06:32:09.614092 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.612281 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" Jul 07 06:32:09.636397 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.636194 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:09.691612 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.691544 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f"] Jul 07 06:32:09.706057 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.703587 2575 generic.go:356] "Generic (PLEG): container finished" podID="16ab1acc-1355-4186-b4e0-51fbf6241b3b" containerID="604cb85aa965a04d1e0045d5544028a7ebd46a8f4b19cfcb98a93d35612a37e0" exitCode=0 Jul 07 06:32:09.706057 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.703679 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" event={"ID":"16ab1acc-1355-4186-b4e0-51fbf6241b3b","Type":"ContainerDied","Data":"604cb85aa965a04d1e0045d5544028a7ebd46a8f4b19cfcb98a93d35612a37e0"} Jul 07 06:32:09.710023 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.708340 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q" event={"ID":"23d1165d-f14c-4f68-a463-ee69c76007d0","Type":"ContainerStarted","Data":"74ad9c73b08e3cc923e1fcd5b3950d172ddb4ded87235e07ae6868423b48e69d"} Jul 07 06:32:09.715425 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.715388 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv"] Jul 07 06:32:09.720363 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:09.720198 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc8cd7b_bac4_4871_a061_95d3a0677d82.slice/crio-120e398594c7918421752c702578d7911c5a13d49514521b5749efbf29e32b89 WatchSource:0}: Error finding container 120e398594c7918421752c702578d7911c5a13d49514521b5749efbf29e32b89: Status 404 returned error can't find the container with id 120e398594c7918421752c702578d7911c5a13d49514521b5749efbf29e32b89 Jul 07 06:32:09.767877 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.767655 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq"] Jul 07 06:32:09.771396 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:09.771364 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0cf7c7a_b953_48f5_9e11_a579660d707f.slice/crio-539ea570d97c288bef0fac6a97cc290278b909871a5cc4aae98f5ada3209a8df WatchSource:0}: Error finding container 539ea570d97c288bef0fac6a97cc290278b909871a5cc4aae98f5ada3209a8df: Status 404 returned error can't find the container with id 539ea570d97c288bef0fac6a97cc290278b909871a5cc4aae98f5ada3209a8df Jul 07 06:32:09.792430 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.792373 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-2rvvr"] Jul 07 06:32:09.794765 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:09.794741 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb4af7c_3cca_4635_afde_dbb8e92d2664.slice/crio-0f04f52ecec7be90f4b5589e9f97aec5c7ef58acb30f8a4c190c7be475c7dcc4 WatchSource:0}: Error finding container 0f04f52ecec7be90f4b5589e9f97aec5c7ef58acb30f8a4c190c7be475c7dcc4: Status 404 returned error can't find the container with id 0f04f52ecec7be90f4b5589e9f97aec5c7ef58acb30f8a4c190c7be475c7dcc4 Jul 07 06:32:09.826463 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.826442 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-cnh47"] Jul 07 06:32:09.829524 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:09.829502 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61f4023_948b_4a84_86a9_0ec309718b46.slice/crio-0e04b80da5e75d5b4e7f6d131499012da08f15defac0c3c7e03ff9c7012f1846 WatchSource:0}: Error finding container 0e04b80da5e75d5b4e7f6d131499012da08f15defac0c3c7e03ff9c7012f1846: Status 404 returned error can't find the container with id 0e04b80da5e75d5b4e7f6d131499012da08f15defac0c3c7e03ff9c7012f1846 Jul 07 06:32:09.855636 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.855582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:09.855724 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.855665 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 06:32:09.855772 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.855728 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls podName:9c732e64-7ccf-4c35-9719-32311c3aba35 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:10.855707787 +0000 UTC m=+43.857787078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wbwx2" (UID: "9c732e64-7ccf-4c35-9719-32311c3aba35") : secret "samples-operator-tls" not found Jul 07 06:32:09.956328 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:09.956262 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:09.956439 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.956402 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:09.956479 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:09.956468 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls podName:45c8dce0-8403-463a-80bf-e6a7c6dceed2 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:10.956451345 +0000 UTC m=+43.958530636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4q4s2" (UID: "45c8dce0-8403-463a-80bf-e6a7c6dceed2") : secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:10.057235 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.057209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:10.057343 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.057273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:10.057384 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:10.057336 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:32:10.057384 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:10.057372 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:11.057356903 +0000 UTC m=+44.059436196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : configmap references non-existent config key: service-ca.crt Jul 07 06:32:10.057449 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:10.057386 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:11.057380303 +0000 UTC m=+44.059459594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : secret "router-metrics-certs-default" not found Jul 07 06:32:10.721454 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.721362 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" event={"ID":"afb4af7c-3cca-4635-afde-dbb8e92d2664","Type":"ContainerStarted","Data":"0f04f52ecec7be90f4b5589e9f97aec5c7ef58acb30f8a4c190c7be475c7dcc4"} Jul 07 06:32:10.725426 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.725351 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" event={"ID":"f0cf7c7a-b953-48f5-9e11-a579660d707f","Type":"ContainerStarted","Data":"539ea570d97c288bef0fac6a97cc290278b909871a5cc4aae98f5ada3209a8df"} Jul 07 06:32:10.727624 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.727555 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" event={"ID":"edc8cd7b-bac4-4871-a061-95d3a0677d82","Type":"ContainerStarted","Data":"120e398594c7918421752c702578d7911c5a13d49514521b5749efbf29e32b89"} Jul 07 06:32:10.730760 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.730691 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f" event={"ID":"38f31e75-dc86-4540-8f5f-1b97975cd15c","Type":"ContainerStarted","Data":"315827ef7afb3883fb47333e14b7dfa4a65fdfe35e90173c428c53f67598dd0a"} Jul 07 06:32:10.733289 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.733213 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" event={"ID":"f61f4023-948b-4a84-86a9-0ec309718b46","Type":"ContainerStarted","Data":"0e04b80da5e75d5b4e7f6d131499012da08f15defac0c3c7e03ff9c7012f1846"} Jul 07 06:32:10.741680 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.741624 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" event={"ID":"16ab1acc-1355-4186-b4e0-51fbf6241b3b","Type":"ContainerStarted","Data":"367581a61729575a09c8b80d8f0d977508d1e3c9e64ffd54692a1551f37077d3"} Jul 07 06:32:10.773532 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.773473 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rwkn7" podStartSLOduration=8.436882648 podStartE2EDuration="42.773446499s" totalImagesPullingTime="34.336563851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:10.76762328 +0000 UTC m=+43.769702595" watchObservedRunningTime="2026-07-07 06:32:10.773446499 +0000 UTC m=+43.775525813" Jul 07 06:32:10.865418 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.864882 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:10.865418 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:10.865012 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 06:32:10.865418 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:10.865058 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls podName:9c732e64-7ccf-4c35-9719-32311c3aba35 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:12.865044852 +0000 UTC m=+45.867124143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wbwx2" (UID: "9c732e64-7ccf-4c35-9719-32311c3aba35") : secret "samples-operator-tls" not found Jul 07 06:32:10.890117 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.890011 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:10.956743 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.956667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:10.966389 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:10.966359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:10.966610 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:10.966592 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:10.966679 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:10.966659 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls podName:45c8dce0-8403-463a-80bf-e6a7c6dceed2 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:12.966642984 +0000 UTC m=+45.968722277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4q4s2" (UID: "45c8dce0-8403-463a-80bf-e6a7c6dceed2") : secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:11.068770 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:11.067913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:11.068770 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:11.068007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:11.068770 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:11.068221 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:13.068201932 +0000 UTC m=+46.070281246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : configmap references non-existent config key: service-ca.crt Jul 07 06:32:11.068770 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:11.068304 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:32:11.068770 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:11.068336 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:13.068325111 +0000 UTC m=+46.070404404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : secret "router-metrics-certs-default" not found Jul 07 06:32:11.675154 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:11.675115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:11.675323 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:11.675222 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:11.675382 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:11.675360 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:32:11.675458 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:11.675439 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls podName:fd8c291f-b8db-4725-97fd-cbb92e48d483 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:19.675415861 +0000 UTC m=+52.677495166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls") pod "dns-default-l6pcn" (UID: "fd8c291f-b8db-4725-97fd-cbb92e48d483") : secret "dns-default-metrics-tls" not found Jul 07 06:32:11.675535 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:11.675359 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:32:11.675583 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:11.675542 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7998b6489d-pmxvc: secret "image-registry-tls" not found Jul 07 06:32:11.675629 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:11.675592 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls podName:699518c9-70c1-42fa-aae5-14b0a24dc49a nodeName:}" failed. No retries permitted until 2026-07-07 06:32:19.675579026 +0000 UTC m=+52.677658322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls") pod "image-registry-7998b6489d-pmxvc" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a") : secret "image-registry-tls" not found Jul 07 06:32:12.748772 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:12.748717 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q" event={"ID":"23d1165d-f14c-4f68-a463-ee69c76007d0","Type":"ContainerStarted","Data":"90368b25e20c24fb87efdc62e0265bcd3e563d6d381160383645b9328c567a65"} Jul 07 06:32:12.768578 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:12.768527 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fvl2q" podStartSLOduration=1.643241437 podStartE2EDuration="3.768506458s" totalImagesPullingTime="2.125265021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:12.766785422 +0000 UTC m=+45.768864748" watchObservedRunningTime="2026-07-07 06:32:12.768506458 +0000 UTC m=+45.770585778" Jul 07 06:32:12.858716 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:12.858688 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:12.886161 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:12.886119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:12.886289 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:12.886269 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 06:32:12.886354 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:12.886340 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls podName:9c732e64-7ccf-4c35-9719-32311c3aba35 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:16.88632104 +0000 UTC m=+49.888400332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wbwx2" (UID: "9c732e64-7ccf-4c35-9719-32311c3aba35") : secret "samples-operator-tls" not found Jul 07 06:32:12.960612 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:12.960575 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:12.987311 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:12.987273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:12.987459 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:12.987429 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:12.987520 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:12.987508 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls podName:45c8dce0-8403-463a-80bf-e6a7c6dceed2 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:16.987485877 +0000 UTC m=+49.989565167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4q4s2" (UID: "45c8dce0-8403-463a-80bf-e6a7c6dceed2") : secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:13.088728 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:13.088658 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:13.088880 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:13.088737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:13.088880 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:13.088836 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:32:13.088988 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:13.088883 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:17.088864984 +0000 UTC m=+50.090944276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : configmap references non-existent config key: service-ca.crt Jul 07 06:32:13.088988 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:13.088905 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:17.08889565 +0000 UTC m=+50.090974941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : secret "router-metrics-certs-default" not found Jul 07 06:32:15.040048 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:15.039959 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:15.097556 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:15.097521 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:16.762427 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.762394 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/0.log" Jul 07 06:32:16.762862 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.762436 2575 generic.go:356] "Generic (PLEG): container finished" podID="f61f4023-948b-4a84-86a9-0ec309718b46" containerID="dc7356c4c220c7c231e43b4f17c7b137b0d9f00ec8c39485fbf0c489b90d2182" exitCode=255 Jul 07 06:32:16.762862 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.762528 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" event={"ID":"f61f4023-948b-4a84-86a9-0ec309718b46","Type":"ContainerDied","Data":"dc7356c4c220c7c231e43b4f17c7b137b0d9f00ec8c39485fbf0c489b90d2182"} Jul 07 06:32:16.762971 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.762864 2575 scope.go:117] "RemoveContainer" containerID="dc7356c4c220c7c231e43b4f17c7b137b0d9f00ec8c39485fbf0c489b90d2182" Jul 07 06:32:16.764910 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.764886 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" event={"ID":"afb4af7c-3cca-4635-afde-dbb8e92d2664","Type":"ContainerStarted","Data":"a0699475df370e2d2fb23533bbd332e1b41e01ea463dbff3f9b15349a4bc4f41"} Jul 07 06:32:16.766726 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.766684 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" event={"ID":"f0cf7c7a-b953-48f5-9e11-a579660d707f","Type":"ContainerStarted","Data":"9f94d32e00b1daaa95993d2f861fd55e4099b7a53d0e8daa6353f236ca7b7023"} Jul 07 06:32:16.768683 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.768660 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" event={"ID":"edc8cd7b-bac4-4871-a061-95d3a0677d82","Type":"ContainerStarted","Data":"1300fb16dcbdaba425be28fc955ffcdb8ad7027c207769038b39b60cc7c379e9"} Jul 07 06:32:16.770628 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.770608 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f" event={"ID":"38f31e75-dc86-4540-8f5f-1b97975cd15c","Type":"ContainerStarted","Data":"1f72f4de12087452ec73b761144ddf32740e2a0651334de1244b31b71e20a66f"} Jul 07 06:32:16.796102 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.796037 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wxf7f" podStartSLOduration=1.372014973 podStartE2EDuration="7.796019815s" totalImagesPullingTime="6.424004842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:16.794712219 +0000 UTC m=+49.796791532" watchObservedRunningTime="2026-07-07 06:32:16.796019815 +0000 UTC m=+49.798099129" Jul 07 06:32:16.811250 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.811201 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" podStartSLOduration=1.417931951 podStartE2EDuration="7.811184124s" totalImagesPullingTime="6.393252173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:16.809570848 +0000 UTC m=+49.811650162" watchObservedRunningTime="2026-07-07 06:32:16.811184124 +0000 UTC m=+49.813263438" Jul 07 06:32:16.828689 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.828627 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" podStartSLOduration=1.5133615009999999 podStartE2EDuration="7.828610395s" totalImagesPullingTime="6.315248894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:16.827241221 +0000 UTC m=+49.829320536" watchObservedRunningTime="2026-07-07 06:32:16.828610395 +0000 UTC m=+49.830689708" Jul 07 06:32:16.847551 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.847511 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" podStartSLOduration=1.50773963 podStartE2EDuration="7.847494567s" totalImagesPullingTime="6.339754937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:16.84601338 +0000 UTC m=+49.848092693" watchObservedRunningTime="2026-07-07 06:32:16.847494567 +0000 UTC m=+49.849573881" Jul 07 06:32:16.928042 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:16.928010 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:16.928226 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:16.928193 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 06:32:16.928295 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:16.928272 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls podName:9c732e64-7ccf-4c35-9719-32311c3aba35 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:24.928250062 +0000 UTC m=+57.930329368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-wbwx2" (UID: "9c732e64-7ccf-4c35-9719-32311c3aba35") : secret "samples-operator-tls" not found Jul 07 06:32:17.029330 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.029254 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:17.029486 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:17.029439 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:17.029555 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:17.029516 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls podName:45c8dce0-8403-463a-80bf-e6a7c6dceed2 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:25.029494261 +0000 UTC m=+58.031573567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4q4s2" (UID: "45c8dce0-8403-463a-80bf-e6a7c6dceed2") : secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:17.094442 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.094405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:17.130621 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.130590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:17.130790 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.130683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:17.130790 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:17.130759 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:32:17.130924 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:17.130834 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:25.130813863 +0000 UTC m=+58.132893159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : secret "router-metrics-certs-default" not found Jul 07 06:32:17.130924 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:17.130853 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:25.130844028 +0000 UTC m=+58.132923327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : configmap references non-existent config key: service-ca.crt Jul 07 06:32:17.193774 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.193740 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:17.324350 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.324263 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cxb9r"] Jul 07 06:32:17.336154 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.336129 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.339254 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.339147 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cxb9r"] Jul 07 06:32:17.339382 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.339264 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 06:32:17.339382 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.339283 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 06:32:17.339483 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.339269 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-68w6b\"" Jul 07 06:32:17.359652 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.359619 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:17.420158 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.420124 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:17.433473 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.433440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16df1bc4-8617-4445-891e-7649c7bff13e-data-volume\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.433649 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.433486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16df1bc4-8617-4445-891e-7649c7bff13e-crio-socket\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.433649 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.433580 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.433649 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.433611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nd96\" (UniqueName: \"kubernetes.io/projected/16df1bc4-8617-4445-891e-7649c7bff13e-kube-api-access-4nd96\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.433649 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.433643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.534513 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.534483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.534676 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.534588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16df1bc4-8617-4445-891e-7649c7bff13e-data-volume\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.534676 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:17.534605 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 06:32:17.534676 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:17.534667 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm podName:16df1bc4-8617-4445-891e-7649c7bff13e nodeName:}" failed. No retries permitted until 2026-07-07 06:32:18.034651968 +0000 UTC m=+51.036731260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxb9r" (UID: "16df1bc4-8617-4445-891e-7649c7bff13e") : configmap "kube-rbac-proxy" not found Jul 07 06:32:17.534841 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.534611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16df1bc4-8617-4445-891e-7649c7bff13e-crio-socket\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.534841 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.534772 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16df1bc4-8617-4445-891e-7649c7bff13e-crio-socket\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.534841 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.534810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.534997 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.534847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nd96\" (UniqueName: \"kubernetes.io/projected/16df1bc4-8617-4445-891e-7649c7bff13e-kube-api-access-4nd96\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.534997 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:17.534914 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 06:32:17.534997 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:17.534956 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls podName:16df1bc4-8617-4445-891e-7649c7bff13e nodeName:}" failed. No retries permitted until 2026-07-07 06:32:18.034945393 +0000 UTC m=+51.037024684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxb9r" (UID: "16df1bc4-8617-4445-891e-7649c7bff13e") : secret "insights-runtime-extractor-tls" not found Jul 07 06:32:17.534997 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.534986 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16df1bc4-8617-4445-891e-7649c7bff13e-data-volume\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.547693 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.547666 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nd96\" (UniqueName: \"kubernetes.io/projected/16df1bc4-8617-4445-891e-7649c7bff13e-kube-api-access-4nd96\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:17.775303 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.775271 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:32:17.775748 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.775733 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/0.log" Jul 07 06:32:17.775805 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.775767 2575 generic.go:356] "Generic (PLEG): container finished" podID="f61f4023-948b-4a84-86a9-0ec309718b46" containerID="cf71015476f8c41d8dd68135f72c5b02ff2518b1b1227339984f446dbcab76d8" exitCode=255 Jul 07 06:32:17.775855 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.775805 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" event={"ID":"f61f4023-948b-4a84-86a9-0ec309718b46","Type":"ContainerDied","Data":"cf71015476f8c41d8dd68135f72c5b02ff2518b1b1227339984f446dbcab76d8"} Jul 07 06:32:17.775905 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.775886 2575 scope.go:117] "RemoveContainer" containerID="dc7356c4c220c7c231e43b4f17c7b137b0d9f00ec8c39485fbf0c489b90d2182" Jul 07 06:32:17.776134 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.776114 2575 scope.go:117] "RemoveContainer" containerID="cf71015476f8c41d8dd68135f72c5b02ff2518b1b1227339984f446dbcab76d8" Jul 07 06:32:17.776333 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:17.776304 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-cnh47_openshift-console-operator(f61f4023-948b-4a84-86a9-0ec309718b46)\"" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" podUID="f61f4023-948b-4a84-86a9-0ec309718b46" Jul 07 06:32:17.784805 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.784779 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:17.845825 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:17.845800 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:18.039303 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.039232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:18.039303 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.039270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:18.039472 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:18.039370 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 06:32:18.039472 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:18.039375 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 06:32:18.039472 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:18.039438 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm podName:16df1bc4-8617-4445-891e-7649c7bff13e nodeName:}" failed. No retries permitted until 2026-07-07 06:32:19.039420728 +0000 UTC m=+52.041500019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxb9r" (UID: "16df1bc4-8617-4445-891e-7649c7bff13e") : configmap "kube-rbac-proxy" not found Jul 07 06:32:18.039472 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:18.039451 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls podName:16df1bc4-8617-4445-891e-7649c7bff13e nodeName:}" failed. No retries permitted until 2026-07-07 06:32:19.039445732 +0000 UTC m=+52.041525023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxb9r" (UID: "16df1bc4-8617-4445-891e-7649c7bff13e") : secret "insights-runtime-extractor-tls" not found Jul 07 06:32:18.342275 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.342157 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:18.349057 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.349034 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p"] Jul 07 06:32:18.370286 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.370259 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p"] Jul 07 06:32:18.370420 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.370380 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p" Jul 07 06:32:18.373122 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.373098 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 06:32:18.374122 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.374099 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cwlhp\"" Jul 07 06:32:18.374231 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.374099 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 06:32:18.411640 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.411613 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:18.441744 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.441717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7fg\" (UniqueName: \"kubernetes.io/projected/34727dcf-7b79-4bf8-8dbf-cca339c19b09-kube-api-access-mk7fg\") pod \"migrator-d57d58cc9-r9x4p\" (UID: \"34727dcf-7b79-4bf8-8dbf-cca339c19b09\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p" Jul 07 06:32:18.479373 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.479328 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:18.522818 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.522794 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j8bqh_e3b3ec4a-096e-4f79-9637-0a030bbeb608/dns-node-resolver/0.log" Jul 07 06:32:18.542835 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.542813 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7fg\" (UniqueName: \"kubernetes.io/projected/34727dcf-7b79-4bf8-8dbf-cca339c19b09-kube-api-access-mk7fg\") pod \"migrator-d57d58cc9-r9x4p\" (UID: \"34727dcf-7b79-4bf8-8dbf-cca339c19b09\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p" Jul 07 06:32:18.553129 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.553107 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7fg\" (UniqueName: \"kubernetes.io/projected/34727dcf-7b79-4bf8-8dbf-cca339c19b09-kube-api-access-mk7fg\") pod \"migrator-d57d58cc9-r9x4p\" (UID: \"34727dcf-7b79-4bf8-8dbf-cca339c19b09\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p" Jul 07 06:32:18.679417 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.679393 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p" Jul 07 06:32:18.781224 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.781202 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:32:18.781613 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.781489 2575 scope.go:117] "RemoveContainer" containerID="cf71015476f8c41d8dd68135f72c5b02ff2518b1b1227339984f446dbcab76d8" Jul 07 06:32:18.781686 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:18.781634 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-cnh47_openshift-console-operator(f61f4023-948b-4a84-86a9-0ec309718b46)\"" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" podUID="f61f4023-948b-4a84-86a9-0ec309718b46" Jul 07 06:32:18.823642 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:18.823616 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p"] Jul 07 06:32:18.826678 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:18.826653 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34727dcf_7b79_4bf8_8dbf_cca339c19b09.slice/crio-cf46666c1ff9fbff974eabf8fa09d6b78decf419f311abdec5a1bb2c3ad385e4 WatchSource:0}: Error finding container cf46666c1ff9fbff974eabf8fa09d6b78decf419f311abdec5a1bb2c3ad385e4: Status 404 returned error can't find the container with id cf46666c1ff9fbff974eabf8fa09d6b78decf419f311abdec5a1bb2c3ad385e4 Jul 07 06:32:19.047461 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.047385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:19.047461 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.047423 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:19.047671 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:19.047539 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 06:32:19.047671 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:19.047582 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 06:32:19.047671 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:19.047598 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls podName:16df1bc4-8617-4445-891e-7649c7bff13e nodeName:}" failed. No retries permitted until 2026-07-07 06:32:21.04758419 +0000 UTC m=+54.049663481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxb9r" (UID: "16df1bc4-8617-4445-891e-7649c7bff13e") : secret "insights-runtime-extractor-tls" not found Jul 07 06:32:19.047671 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:19.047651 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm podName:16df1bc4-8617-4445-891e-7649c7bff13e nodeName:}" failed. No retries permitted until 2026-07-07 06:32:21.047633581 +0000 UTC m=+54.049712892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxb9r" (UID: "16df1bc4-8617-4445-891e-7649c7bff13e") : configmap "kube-rbac-proxy" not found Jul 07 06:32:19.379806 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.379735 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fh5rd"] Jul 07 06:32:19.412576 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.412548 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:19.412576 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.412568 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fh5rd"] Jul 07 06:32:19.412781 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.412671 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.417371 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.417346 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6mtps\"" Jul 07 06:32:19.417490 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.417346 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 06:32:19.417490 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.417395 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 06:32:19.418283 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.418262 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 06:32:19.418372 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.418333 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 06:32:19.450643 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.450617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbw5\" (UniqueName: \"kubernetes.io/projected/e909d623-d323-4139-89d7-bc6b8285cae4-kube-api-access-5pbw5\") pod \"service-ca-758f599c5-fh5rd\" (UID: \"e909d623-d323-4139-89d7-bc6b8285cae4\") " pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.450736 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.450648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e909d623-d323-4139-89d7-bc6b8285cae4-signing-cabundle\") pod \"service-ca-758f599c5-fh5rd\" (UID: \"e909d623-d323-4139-89d7-bc6b8285cae4\") " pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.450736 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.450686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e909d623-d323-4139-89d7-bc6b8285cae4-signing-key\") pod \"service-ca-758f599c5-fh5rd\" (UID: \"e909d623-d323-4139-89d7-bc6b8285cae4\") " pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.522542 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.522523 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r949v_39efcee3-3895-4b99-883c-273bba95191b/node-ca/0.log" Jul 07 06:32:19.551647 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.551625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbw5\" (UniqueName: \"kubernetes.io/projected/e909d623-d323-4139-89d7-bc6b8285cae4-kube-api-access-5pbw5\") pod \"service-ca-758f599c5-fh5rd\" (UID: \"e909d623-d323-4139-89d7-bc6b8285cae4\") " pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.551729 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.551656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e909d623-d323-4139-89d7-bc6b8285cae4-signing-cabundle\") pod \"service-ca-758f599c5-fh5rd\" (UID: \"e909d623-d323-4139-89d7-bc6b8285cae4\") " pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.551729 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.551682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e909d623-d323-4139-89d7-bc6b8285cae4-signing-key\") pod \"service-ca-758f599c5-fh5rd\" (UID: \"e909d623-d323-4139-89d7-bc6b8285cae4\") " pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.552356 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.552329 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e909d623-d323-4139-89d7-bc6b8285cae4-signing-cabundle\") pod \"service-ca-758f599c5-fh5rd\" (UID: \"e909d623-d323-4139-89d7-bc6b8285cae4\") " pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.554082 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.554053 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e909d623-d323-4139-89d7-bc6b8285cae4-signing-key\") pod \"service-ca-758f599c5-fh5rd\" (UID: \"e909d623-d323-4139-89d7-bc6b8285cae4\") " pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.560503 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.560482 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbw5\" (UniqueName: \"kubernetes.io/projected/e909d623-d323-4139-89d7-bc6b8285cae4-kube-api-access-5pbw5\") pod \"service-ca-758f599c5-fh5rd\" (UID: \"e909d623-d323-4139-89d7-bc6b8285cae4\") " pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.636886 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.636754 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:19.636886 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.636817 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:19.725553 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.725513 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-fh5rd" Jul 07 06:32:19.754251 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.754215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:19.754369 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.754309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:19.754436 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:19.754372 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:32:19.754491 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:19.754438 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:32:19.754491 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:19.754449 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls podName:fd8c291f-b8db-4725-97fd-cbb92e48d483 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:35.754428628 +0000 UTC m=+68.756507944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls") pod "dns-default-l6pcn" (UID: "fd8c291f-b8db-4725-97fd-cbb92e48d483") : secret "dns-default-metrics-tls" not found Jul 07 06:32:19.754491 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:19.754452 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7998b6489d-pmxvc: secret "image-registry-tls" not found Jul 07 06:32:19.754491 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:19.754485 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls podName:699518c9-70c1-42fa-aae5-14b0a24dc49a nodeName:}" failed. No retries permitted until 2026-07-07 06:32:35.754474814 +0000 UTC m=+68.756554105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls") pod "image-registry-7998b6489d-pmxvc" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a") : secret "image-registry-tls" not found Jul 07 06:32:19.785152 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.785109 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p" event={"ID":"34727dcf-7b79-4bf8-8dbf-cca339c19b09","Type":"ContainerStarted","Data":"cf46666c1ff9fbff974eabf8fa09d6b78decf419f311abdec5a1bb2c3ad385e4"} Jul 07 06:32:19.785519 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.785408 2575 scope.go:117] "RemoveContainer" containerID="cf71015476f8c41d8dd68135f72c5b02ff2518b1b1227339984f446dbcab76d8" Jul 07 06:32:19.785712 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:19.785692 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-cnh47_openshift-console-operator(f61f4023-948b-4a84-86a9-0ec309718b46)\"" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" podUID="f61f4023-948b-4a84-86a9-0ec309718b46" Jul 07 06:32:19.865613 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:19.865586 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fh5rd"] Jul 07 06:32:19.868598 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:19.868573 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode909d623_d323_4139_89d7_bc6b8285cae4.slice/crio-e899dbda4aabcbaa9238f52d172b63f90aa411461b30456022350f79ca416d27 WatchSource:0}: Error finding container e899dbda4aabcbaa9238f52d172b63f90aa411461b30456022350f79ca416d27: Status 404 returned error can't find the container with id e899dbda4aabcbaa9238f52d172b63f90aa411461b30456022350f79ca416d27 Jul 07 06:32:20.123887 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:20.123846 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jsbmz_d3e1680c-1cc4-4edc-9548-d925aacfe2de/serve-healthcheck-canary/0.log" Jul 07 06:32:20.284031 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:20.283948 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:20.786634 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:20.786598 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:20.795701 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:20.795670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-fh5rd" event={"ID":"e909d623-d323-4139-89d7-bc6b8285cae4","Type":"ContainerStarted","Data":"ad23fe3e933f19924aeb4c3bc9c0af5a631d601e8e9e5e2cc45e0e1f37507582"} Jul 07 06:32:20.795886 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:20.795726 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-fh5rd" event={"ID":"e909d623-d323-4139-89d7-bc6b8285cae4","Type":"ContainerStarted","Data":"e899dbda4aabcbaa9238f52d172b63f90aa411461b30456022350f79ca416d27"} Jul 07 06:32:20.939179 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:20.939146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:21.041426 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.041365 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:21.065996 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.065976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:21.066134 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.066030 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:21.066345 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:21.066270 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 06:32:21.066345 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:21.066297 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 06:32:21.066345 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:21.066333 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm podName:16df1bc4-8617-4445-891e-7649c7bff13e nodeName:}" failed. No retries permitted until 2026-07-07 06:32:25.066314151 +0000 UTC m=+58.068393445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxb9r" (UID: "16df1bc4-8617-4445-891e-7649c7bff13e") : configmap "kube-rbac-proxy" not found Jul 07 06:32:21.066536 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:21.066352 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls podName:16df1bc4-8617-4445-891e-7649c7bff13e nodeName:}" failed. No retries permitted until 2026-07-07 06:32:25.066341759 +0000 UTC m=+58.068421051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxb9r" (UID: "16df1bc4-8617-4445-891e-7649c7bff13e") : secret "insights-runtime-extractor-tls" not found Jul 07 06:32:21.138569 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.138535 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:21.240580 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.240507 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:21.680058 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.680026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:21.800408 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.800374 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p" event={"ID":"34727dcf-7b79-4bf8-8dbf-cca339c19b09","Type":"ContainerStarted","Data":"86b6927c7238d829357e87167496163a4055036c84661cf2a94a7e4874d7774c"} Jul 07 06:32:21.800827 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.800428 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p" event={"ID":"34727dcf-7b79-4bf8-8dbf-cca339c19b09","Type":"ContainerStarted","Data":"e669b7fc4b3c451a92e105d12f235ee932b05e1b4ff4aa3c4e20b696cfc32e50"} Jul 07 06:32:21.818997 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.818944 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-fh5rd" podStartSLOduration=2.818924625 podStartE2EDuration="2.818924625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:20.814338062 +0000 UTC m=+53.816417377" watchObservedRunningTime="2026-07-07 06:32:21.818924625 +0000 UTC m=+54.821003938" Jul 07 06:32:21.819567 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.819535 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-r9x4p" podStartSLOduration=1.8220409800000001 podStartE2EDuration="3.819525418s" totalImagesPullingTime="1.997484438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:21.818781789 +0000 UTC m=+54.820861102" watchObservedRunningTime="2026-07-07 06:32:21.819525418 +0000 UTC m=+54.821604724" Jul 07 06:32:21.886166 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:21.886134 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:22.882854 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:22.882819 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:23.082471 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:23.082440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:23.440311 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:23.440278 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:23.537892 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:23.537847 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:23.612660 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:23.612628 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:23.691322 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:23.691259 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:24.089409 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:24.089324 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:24.478973 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:24.478946 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:24.580311 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:24.580283 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:24.879646 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:24.879560 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:25.000300 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.000265 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:25.002828 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.002795 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c732e64-7ccf-4c35-9719-32311c3aba35-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-wbwx2\" (UID: \"9c732e64-7ccf-4c35-9719-32311c3aba35\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:25.019589 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.019542 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" Jul 07 06:32:25.078167 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.077998 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:25.101342 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.101055 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:25.101342 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.101123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:25.101342 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.101169 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:25.101342 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:25.101238 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 06:32:25.101342 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:25.101270 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 06:32:25.101342 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:25.101274 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:25.101342 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:25.101327 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls podName:16df1bc4-8617-4445-891e-7649c7bff13e nodeName:}" failed. No retries permitted until 2026-07-07 06:32:33.101307368 +0000 UTC m=+66.103386667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxb9r" (UID: "16df1bc4-8617-4445-891e-7649c7bff13e") : secret "insights-runtime-extractor-tls" not found Jul 07 06:32:25.101342 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:25.101348 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm podName:16df1bc4-8617-4445-891e-7649c7bff13e nodeName:}" failed. No retries permitted until 2026-07-07 06:32:33.101336856 +0000 UTC m=+66.103416153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxb9r" (UID: "16df1bc4-8617-4445-891e-7649c7bff13e") : configmap "kube-rbac-proxy" not found Jul 07 06:32:25.101963 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:25.101363 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls podName:45c8dce0-8403-463a-80bf-e6a7c6dceed2 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:41.101354342 +0000 UTC m=+74.103433640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4q4s2" (UID: "45c8dce0-8403-463a-80bf-e6a7c6dceed2") : secret "cluster-monitoring-operator-tls" not found Jul 07 06:32:25.148877 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.148804 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2"] Jul 07 06:32:25.152353 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.152322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:25.201858 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.201836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:25.201956 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.201936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:25.202033 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:25.202017 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:41.201993841 +0000 UTC m=+74.204073134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : configmap references non-existent config key: service-ca.crt Jul 07 06:32:25.202099 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:25.202040 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:32:25.202099 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:32:25.202098 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs podName:cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6 nodeName:}" failed. No retries permitted until 2026-07-07 06:32:41.202067995 +0000 UTC m=+74.204147305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs") pod "router-default-9cd96565c-krjmm" (UID: "cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6") : secret "router-metrics-certs-default" not found Jul 07 06:32:25.481307 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.481270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:25.679898 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.679864 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:25.813395 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:25.813316 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" event={"ID":"9c732e64-7ccf-4c35-9719-32311c3aba35","Type":"ContainerStarted","Data":"8ac2f5de03d8fd2dfbfcca045f5fdc52835f9d306080acaa9dc9489846a1a468"} Jul 07 06:32:26.278838 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:26.278801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:26.679583 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:26.679554 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:27.118714 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:27.118634 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:27.220973 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:27.220938 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:27.321535 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:27.321502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:27.823896 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:27.823866 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" event={"ID":"9c732e64-7ccf-4c35-9719-32311c3aba35","Type":"ContainerStarted","Data":"39f916b2ede19d3e40b1afd47e06978506ec63571f4fb99b6eb70035e77df1d1"} Jul 07 06:32:27.824033 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:27.823924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" event={"ID":"9c732e64-7ccf-4c35-9719-32311c3aba35","Type":"ContainerStarted","Data":"feac421f9fae34fde356204def8ba5ea0384a6a7536832c127d21c7ab0374147"} Jul 07 06:32:27.842786 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:27.842743 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-wbwx2" podStartSLOduration=16.368012403 podStartE2EDuration="18.842724421s" totalImagesPullingTime="2.474712018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:27.841903233 +0000 UTC m=+60.843982547" watchObservedRunningTime="2026-07-07 06:32:27.842724421 +0000 UTC m=+60.844803731" Jul 07 06:32:27.877423 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:27.877399 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" limit=1024 Jul 07 06:32:29.673808 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:29.673782 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j79sd" Jul 07 06:32:33.163762 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.163727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:33.164130 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.163851 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:33.164252 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.164232 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16df1bc4-8617-4445-891e-7649c7bff13e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:33.166147 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.166127 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16df1bc4-8617-4445-891e-7649c7bff13e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxb9r\" (UID: \"16df1bc4-8617-4445-891e-7649c7bff13e\") " pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:33.250088 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.250044 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-68w6b\"" Jul 07 06:32:33.257326 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.257311 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cxb9r" Jul 07 06:32:33.264218 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.264198 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:32:33.264312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.264273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:32:33.267378 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.267341 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 06:32:33.267474 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.267381 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 06:32:33.277014 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.276990 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc2b4af1-d047-4ad8-8951-c1a020da2030-metrics-certs\") pod \"network-metrics-daemon-ph8qs\" (UID: \"bc2b4af1-d047-4ad8-8951-c1a020da2030\") " pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:32:33.277113 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.277047 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3-original-pull-secret\") pod \"global-pull-secret-syncer-zmwbj\" (UID: \"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3\") " pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:32:33.364942 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.364914 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9nl\" (UniqueName: \"kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl\") pod \"network-check-target-rcpd5\" (UID: \"54902f7d-66fe-49c9-a0e2-70bf30a93765\") " pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:32:33.367404 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.367377 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n9nl\" (UniqueName: \"kubernetes.io/projected/54902f7d-66fe-49c9-a0e2-70bf30a93765-kube-api-access-2n9nl\") pod \"network-check-target-rcpd5\" (UID: \"54902f7d-66fe-49c9-a0e2-70bf30a93765\") " pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:32:33.378196 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.378178 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cxb9r"] Jul 07 06:32:33.380473 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:33.380450 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16df1bc4_8617_4445_891e_7649c7bff13e.slice/crio-c8edbd22b87cf1d6196128b23208ce8f06c88402716d2178fafa7fe4eaba90b9 WatchSource:0}: Error finding container c8edbd22b87cf1d6196128b23208ce8f06c88402716d2178fafa7fe4eaba90b9: Status 404 returned error can't find the container with id c8edbd22b87cf1d6196128b23208ce8f06c88402716d2178fafa7fe4eaba90b9 Jul 07 06:32:33.435634 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.435616 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zmwbj" Jul 07 06:32:33.446295 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.446277 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dsscv\"" Jul 07 06:32:33.451617 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.451599 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wsxr\"" Jul 07 06:32:33.454688 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.454671 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:32:33.460028 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.460014 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ph8qs" Jul 07 06:32:33.584109 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.583994 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zmwbj"] Jul 07 06:32:33.606960 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:33.606932 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3ac366_ff6b_4aab_822a_c9dbfbd4f5b3.slice/crio-755c3facdcdb26bca22093418ff19713c89b02bf8353ea7f54e2ff72ce679362 WatchSource:0}: Error finding container 755c3facdcdb26bca22093418ff19713c89b02bf8353ea7f54e2ff72ce679362: Status 404 returned error can't find the container with id 755c3facdcdb26bca22093418ff19713c89b02bf8353ea7f54e2ff72ce679362 Jul 07 06:32:33.806178 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.806154 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rcpd5"] Jul 07 06:32:33.808147 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:33.808061 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54902f7d_66fe_49c9_a0e2_70bf30a93765.slice/crio-7db4f16b717e6993989d80a1404fd0d9a6fd2819a65c60df39118755520ab081 WatchSource:0}: Error finding container 7db4f16b717e6993989d80a1404fd0d9a6fd2819a65c60df39118755520ab081: Status 404 returned error can't find the container with id 7db4f16b717e6993989d80a1404fd0d9a6fd2819a65c60df39118755520ab081 Jul 07 06:32:33.810564 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.810547 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ph8qs"] Jul 07 06:32:33.812551 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:33.812524 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2b4af1_d047_4ad8_8951_c1a020da2030.slice/crio-675eafb9114f66b4f50f14d26643b6d1a5a8426def2962d8d0e4d65633cb3219 WatchSource:0}: Error finding container 675eafb9114f66b4f50f14d26643b6d1a5a8426def2962d8d0e4d65633cb3219: Status 404 returned error can't find the container with id 675eafb9114f66b4f50f14d26643b6d1a5a8426def2962d8d0e4d65633cb3219 Jul 07 06:32:33.848246 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.848217 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zmwbj" event={"ID":"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3","Type":"ContainerStarted","Data":"755c3facdcdb26bca22093418ff19713c89b02bf8353ea7f54e2ff72ce679362"} Jul 07 06:32:33.849366 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.849343 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rcpd5" event={"ID":"54902f7d-66fe-49c9-a0e2-70bf30a93765","Type":"ContainerStarted","Data":"7db4f16b717e6993989d80a1404fd0d9a6fd2819a65c60df39118755520ab081"} Jul 07 06:32:33.850524 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.850501 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxb9r" event={"ID":"16df1bc4-8617-4445-891e-7649c7bff13e","Type":"ContainerStarted","Data":"c8edbd22b87cf1d6196128b23208ce8f06c88402716d2178fafa7fe4eaba90b9"} Jul 07 06:32:33.851721 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:33.851701 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ph8qs" event={"ID":"bc2b4af1-d047-4ad8-8951-c1a020da2030","Type":"ContainerStarted","Data":"675eafb9114f66b4f50f14d26643b6d1a5a8426def2962d8d0e4d65633cb3219"} Jul 07 06:32:34.521883 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:34.521853 2575 scope.go:117] "RemoveContainer" containerID="cf71015476f8c41d8dd68135f72c5b02ff2518b1b1227339984f446dbcab76d8" Jul 07 06:32:34.860946 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:34.860849 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rcpd5" event={"ID":"54902f7d-66fe-49c9-a0e2-70bf30a93765","Type":"ContainerStarted","Data":"ae9ea3259bddea66217ae62af3a5c3907b39201924687e04843fbbe2f94e7251"} Jul 07 06:32:34.861249 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:34.861176 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:32:34.864242 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:34.864037 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:32:34.864242 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:34.864190 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" event={"ID":"f61f4023-948b-4a84-86a9-0ec309718b46","Type":"ContainerStarted","Data":"9d8db6a995d581370701012fa0fc1baebe17ccc606b792299fa37ca4b5dcd1ac"} Jul 07 06:32:34.864668 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:34.864648 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:34.899354 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:34.897005 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" podStartSLOduration=19.612720976 podStartE2EDuration="25.896990708s" totalImagesPullingTime="6.284269732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:34.896296461 +0000 UTC m=+67.898375777" watchObservedRunningTime="2026-07-07 06:32:34.896990708 +0000 UTC m=+67.899070022" Jul 07 06:32:34.899354 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:34.897639 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rcpd5" podStartSLOduration=66.897628308 podStartE2EDuration="1m6.897628308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:34.878981442 +0000 UTC m=+67.881060775" watchObservedRunningTime="2026-07-07 06:32:34.897628308 +0000 UTC m=+67.899707622" Jul 07 06:32:35.788913 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:35.788879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:35.789420 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:35.788958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:35.793497 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:35.793459 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c291f-b8db-4725-97fd-cbb92e48d483-metrics-tls\") pod \"dns-default-l6pcn\" (UID: \"fd8c291f-b8db-4725-97fd-cbb92e48d483\") " pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:35.793630 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:35.793521 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") pod \"image-registry-7998b6489d-pmxvc\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:35.805603 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:35.805581 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-cnh47" Jul 07 06:32:35.870020 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:35.869984 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ph8qs" event={"ID":"bc2b4af1-d047-4ad8-8951-c1a020da2030","Type":"ContainerStarted","Data":"c682743f7172bcd60ab89bedcbe4404d7ca017768f1cf6d8ddc51848d74f1ef7"} Jul 07 06:32:35.954931 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:35.954176 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-htvtq\"" Jul 07 06:32:35.961737 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:35.961709 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:35.973451 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:35.973428 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lfbmp\"" Jul 07 06:32:35.981437 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:35.981419 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:39.351204 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.351148 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7998b6489d-pmxvc"] Jul 07 06:32:39.354560 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:39.354522 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699518c9_70c1_42fa_aae5_14b0a24dc49a.slice/crio-2ded543c8aa7394bb2bf94ef7bd28b34efdfbd8e17f7056a10cc78ea356b06b0 WatchSource:0}: Error finding container 2ded543c8aa7394bb2bf94ef7bd28b34efdfbd8e17f7056a10cc78ea356b06b0: Status 404 returned error can't find the container with id 2ded543c8aa7394bb2bf94ef7bd28b34efdfbd8e17f7056a10cc78ea356b06b0 Jul 07 06:32:39.365575 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.365553 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l6pcn"] Jul 07 06:32:39.368638 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:39.368592 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8c291f_b8db_4725_97fd_cbb92e48d483.slice/crio-0dd9774e80d25f36bd6d7f481f0900be8bd75dd1be05eefbc63daf4a4a2fd053 WatchSource:0}: Error finding container 0dd9774e80d25f36bd6d7f481f0900be8bd75dd1be05eefbc63daf4a4a2fd053: Status 404 returned error can't find the container with id 0dd9774e80d25f36bd6d7f481f0900be8bd75dd1be05eefbc63daf4a4a2fd053 Jul 07 06:32:39.799597 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.799553 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn"] Jul 07 06:32:39.804942 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.804920 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rqhct"] Jul 07 06:32:39.805114 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.805051 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:39.807614 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.807585 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm"] Jul 07 06:32:39.807737 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.807713 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" Jul 07 06:32:39.808783 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.808760 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 06:32:39.808864 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.808790 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 06:32:39.808907 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.808764 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 06:32:39.809302 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.809282 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 06:32:39.810425 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.810406 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vdbjj\"" Jul 07 06:32:39.810510 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.810410 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 06:32:39.810510 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.810440 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 06:32:39.810631 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.810616 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h"] Jul 07 06:32:39.810699 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.810685 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" Jul 07 06:32:39.813391 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.813367 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6jgrj\"" Jul 07 06:32:39.813487 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.813394 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 06:32:39.814594 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.814577 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:39.817113 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.817096 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 06:32:39.817824 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.817766 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 06:32:39.817928 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.817861 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 06:32:39.818311 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.818294 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 06:32:39.825139 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.825117 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rqhct"] Jul 07 06:32:39.826303 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.826285 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn"] Jul 07 06:32:39.830189 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.830169 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm"] Jul 07 06:32:39.842791 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.842770 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h"] Jul 07 06:32:39.889362 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.889326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ph8qs" event={"ID":"bc2b4af1-d047-4ad8-8951-c1a020da2030","Type":"ContainerStarted","Data":"b757331118758f5301b53f5285a003debca84246bd5c3644930efd6e87e699e9"} Jul 07 06:32:39.890529 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.890506 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-6q8w6"] Jul 07 06:32:39.912023 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.912003 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:32:39.912175 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.912035 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6pcn" event={"ID":"fd8c291f-b8db-4725-97fd-cbb92e48d483","Type":"ContainerStarted","Data":"0dd9774e80d25f36bd6d7f481f0900be8bd75dd1be05eefbc63daf4a4a2fd053"} Jul 07 06:32:39.912175 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.912064 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" event={"ID":"699518c9-70c1-42fa-aae5-14b0a24dc49a","Type":"ContainerStarted","Data":"c1391633c1b62c2f91ff73dd260fb9127765df0d590f8b1530c14c51c1426699"} Jul 07 06:32:39.912175 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.912112 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" event={"ID":"699518c9-70c1-42fa-aae5-14b0a24dc49a","Type":"ContainerStarted","Data":"2ded543c8aa7394bb2bf94ef7bd28b34efdfbd8e17f7056a10cc78ea356b06b0"} Jul 07 06:32:39.912175 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.912125 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-6q8w6" Jul 07 06:32:39.912175 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.912133 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zmwbj" event={"ID":"cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3","Type":"ContainerStarted","Data":"7d50441bef218a8a935bfddf6e902d92d61c8714ec7de8c625319c63afe3bb2c"} Jul 07 06:32:39.912175 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.912153 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxb9r" event={"ID":"16df1bc4-8617-4445-891e-7649c7bff13e","Type":"ContainerStarted","Data":"4c044d0b4ad7b7c404bfc46e78933e78ae756d9d326fd5b64d5a7afc887ed347"} Jul 07 06:32:39.914860 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.914839 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-6q8w6"] Jul 07 06:32:39.916130 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.916107 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 06:32:39.916233 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.916107 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5rg5t\"" Jul 07 06:32:39.917024 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.916993 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 06:32:39.923564 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:39.923666 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:39.923666 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6da6b9f0-0545-485d-9c49-5dea39058520-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rqhct\" (UID: \"6da6b9f0-0545-485d-9c49-5dea39058520\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" Jul 07 06:32:39.923778 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923676 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97d2346c-f029-435b-a97e-d298e8df1959-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cdbfb97d4-n87qm\" (UID: \"97d2346c-f029-435b-a97e-d298e8df1959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" Jul 07 06:32:39.923778 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d2sg\" (UniqueName: \"kubernetes.io/projected/9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae-kube-api-access-8d2sg\") pod \"klusterlet-addon-workmgr-66bd5dd487-6rjxn\" (UID: \"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:39.923778 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923772 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-hub\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:39.923938 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:39.923938 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae-tmp\") pod \"klusterlet-addon-workmgr-66bd5dd487-6rjxn\" (UID: \"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:39.923938 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae-klusterlet-config\") pod \"klusterlet-addon-workmgr-66bd5dd487-6rjxn\" (UID: \"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:39.923938 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6da6b9f0-0545-485d-9c49-5dea39058520-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rqhct\" (UID: \"6da6b9f0-0545-485d-9c49-5dea39058520\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" Jul 07 06:32:39.924173 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923950 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsnn9\" (UniqueName: \"kubernetes.io/projected/97d2346c-f029-435b-a97e-d298e8df1959-kube-api-access-rsnn9\") pod \"managed-serviceaccount-addon-agent-cdbfb97d4-n87qm\" (UID: \"97d2346c-f029-435b-a97e-d298e8df1959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" Jul 07 06:32:39.924173 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.923976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-ca\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:39.924173 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.924006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjx5s\" (UniqueName: \"kubernetes.io/projected/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-kube-api-access-xjx5s\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:39.985972 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:39.985926 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" podStartSLOduration=58.985913289 podStartE2EDuration="58.985913289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:39.984863829 +0000 UTC m=+72.986943154" watchObservedRunningTime="2026-07-07 06:32:39.985913289 +0000 UTC m=+72.987992602" Jul 07 06:32:40.025404 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.025530 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.025530 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6da6b9f0-0545-485d-9c49-5dea39058520-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rqhct\" (UID: \"6da6b9f0-0545-485d-9c49-5dea39058520\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" Jul 07 06:32:40.025530 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97d2346c-f029-435b-a97e-d298e8df1959-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cdbfb97d4-n87qm\" (UID: \"97d2346c-f029-435b-a97e-d298e8df1959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" Jul 07 06:32:40.025530 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2sg\" (UniqueName: \"kubernetes.io/projected/9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae-kube-api-access-8d2sg\") pod \"klusterlet-addon-workmgr-66bd5dd487-6rjxn\" (UID: \"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:40.025753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025563 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2t4n\" (UniqueName: \"kubernetes.io/projected/a6f7e13c-8773-438a-bc34-49dcd380ff4a-kube-api-access-c2t4n\") pod \"downloads-685bfb5f64-6q8w6\" (UID: \"a6f7e13c-8773-438a-bc34-49dcd380ff4a\") " pod="openshift-console/downloads-685bfb5f64-6q8w6" Jul 07 06:32:40.025753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-hub\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.025753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.025753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae-tmp\") pod \"klusterlet-addon-workmgr-66bd5dd487-6rjxn\" (UID: \"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:40.025753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae-klusterlet-config\") pod \"klusterlet-addon-workmgr-66bd5dd487-6rjxn\" (UID: \"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:40.025753 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025718 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6da6b9f0-0545-485d-9c49-5dea39058520-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rqhct\" (UID: \"6da6b9f0-0545-485d-9c49-5dea39058520\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" Jul 07 06:32:40.026228 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsnn9\" (UniqueName: \"kubernetes.io/projected/97d2346c-f029-435b-a97e-d298e8df1959-kube-api-access-rsnn9\") pod \"managed-serviceaccount-addon-agent-cdbfb97d4-n87qm\" (UID: \"97d2346c-f029-435b-a97e-d298e8df1959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" Jul 07 06:32:40.026228 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025821 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-ca\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.026228 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.025851 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjx5s\" (UniqueName: \"kubernetes.io/projected/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-kube-api-access-xjx5s\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.026379 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.026246 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6da6b9f0-0545-485d-9c49-5dea39058520-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rqhct\" (UID: \"6da6b9f0-0545-485d-9c49-5dea39058520\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" Jul 07 06:32:40.026466 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.026420 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.027623 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.026966 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae-tmp\") pod \"klusterlet-addon-workmgr-66bd5dd487-6rjxn\" (UID: \"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:40.028718 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.028695 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-hub\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.028897 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.028867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.029115 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.029086 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97d2346c-f029-435b-a97e-d298e8df1959-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cdbfb97d4-n87qm\" (UID: \"97d2346c-f029-435b-a97e-d298e8df1959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" Jul 07 06:32:40.029649 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.029625 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6da6b9f0-0545-485d-9c49-5dea39058520-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rqhct\" (UID: \"6da6b9f0-0545-485d-9c49-5dea39058520\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" Jul 07 06:32:40.029938 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.029915 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-ca\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.030002 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.029954 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.030180 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.030164 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae-klusterlet-config\") pod \"klusterlet-addon-workmgr-66bd5dd487-6rjxn\" (UID: \"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:40.040713 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.040652 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zmwbj" podStartSLOduration=66.447552 podStartE2EDuration="1m12.040638302s" totalImagesPullingTime="5.593086302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:40.010733687 +0000 UTC m=+73.012813001" watchObservedRunningTime="2026-07-07 06:32:40.040638302 +0000 UTC m=+73.042717617" Jul 07 06:32:40.041305 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.041276 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjx5s\" (UniqueName: \"kubernetes.io/projected/0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6-kube-api-access-xjx5s\") pod \"cluster-proxy-proxy-agent-6c6794dcd5-qrg4h\" (UID: \"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.044541 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.044518 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsnn9\" (UniqueName: \"kubernetes.io/projected/97d2346c-f029-435b-a97e-d298e8df1959-kube-api-access-rsnn9\") pod \"managed-serviceaccount-addon-agent-cdbfb97d4-n87qm\" (UID: \"97d2346c-f029-435b-a97e-d298e8df1959\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" Jul 07 06:32:40.048016 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.047986 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d2sg\" (UniqueName: \"kubernetes.io/projected/9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae-kube-api-access-8d2sg\") pod \"klusterlet-addon-workmgr-66bd5dd487-6rjxn\" (UID: \"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:40.068828 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.068750 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ph8qs" podStartSLOduration=70.626885385 podStartE2EDuration="1m12.068730187s" totalImagesPullingTime="1.441844802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:40.068039388 +0000 UTC m=+73.070118702" watchObservedRunningTime="2026-07-07 06:32:40.068730187 +0000 UTC m=+73.070809501" Jul 07 06:32:40.117498 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.117466 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:40.126644 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.126612 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" Jul 07 06:32:40.126838 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.126811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2t4n\" (UniqueName: \"kubernetes.io/projected/a6f7e13c-8773-438a-bc34-49dcd380ff4a-kube-api-access-c2t4n\") pod \"downloads-685bfb5f64-6q8w6\" (UID: \"a6f7e13c-8773-438a-bc34-49dcd380ff4a\") " pod="openshift-console/downloads-685bfb5f64-6q8w6" Jul 07 06:32:40.138015 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.137981 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2t4n\" (UniqueName: \"kubernetes.io/projected/a6f7e13c-8773-438a-bc34-49dcd380ff4a-kube-api-access-c2t4n\") pod \"downloads-685bfb5f64-6q8w6\" (UID: \"a6f7e13c-8773-438a-bc34-49dcd380ff4a\") " pod="openshift-console/downloads-685bfb5f64-6q8w6" Jul 07 06:32:40.143236 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.143215 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" Jul 07 06:32:40.148456 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.148434 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" Jul 07 06:32:40.232373 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.232168 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-6q8w6" Jul 07 06:32:40.355623 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.355595 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rqhct"] Jul 07 06:32:40.365201 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:40.365139 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da6b9f0_0545_485d_9c49_5dea39058520.slice/crio-5839490f162fc8c5572af1c0e168e1dada6eedb69f32ef5f0763546c064f32da WatchSource:0}: Error finding container 5839490f162fc8c5572af1c0e168e1dada6eedb69f32ef5f0763546c064f32da: Status 404 returned error can't find the container with id 5839490f162fc8c5572af1c0e168e1dada6eedb69f32ef5f0763546c064f32da Jul 07 06:32:40.390465 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.390421 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn"] Jul 07 06:32:40.410332 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.410292 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm"] Jul 07 06:32:40.430329 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.429701 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h"] Jul 07 06:32:40.464508 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.464415 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-6q8w6"] Jul 07 06:32:40.558729 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:40.558695 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9faec491_e6b7_4bc5_8faa_c2ae5cbfb1ae.slice/crio-9bc23c7dcc118356af592fa20dabb97ec64a8c5b882c1190e41d9807443699b5 WatchSource:0}: Error finding container 9bc23c7dcc118356af592fa20dabb97ec64a8c5b882c1190e41d9807443699b5: Status 404 returned error can't find the container with id 9bc23c7dcc118356af592fa20dabb97ec64a8c5b882c1190e41d9807443699b5 Jul 07 06:32:40.559522 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:40.559497 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97d2346c_f029_435b_a97e_d298e8df1959.slice/crio-61465735a860b8c395c9cabf98497d7e3e1cc8230bbb2117e570c1ea301220cc WatchSource:0}: Error finding container 61465735a860b8c395c9cabf98497d7e3e1cc8230bbb2117e570c1ea301220cc: Status 404 returned error can't find the container with id 61465735a860b8c395c9cabf98497d7e3e1cc8230bbb2117e570c1ea301220cc Jul 07 06:32:40.560293 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:40.560260 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0820bcfb_20f8_49c3_8c5f_1a0c4a821ac6.slice/crio-9c9620f2fc3ac87c82fb79c0eb381be6ab619e1d12d8efc221922e8330176716 WatchSource:0}: Error finding container 9c9620f2fc3ac87c82fb79c0eb381be6ab619e1d12d8efc221922e8330176716: Status 404 returned error can't find the container with id 9c9620f2fc3ac87c82fb79c0eb381be6ab619e1d12d8efc221922e8330176716 Jul 07 06:32:40.561114 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:40.561011 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f7e13c_8773_438a_bc34_49dcd380ff4a.slice/crio-f3be680ca82ce4a4fe022804325fcaac08e3ba89f5ba2c190b7ccb099600136d WatchSource:0}: Error finding container f3be680ca82ce4a4fe022804325fcaac08e3ba89f5ba2c190b7ccb099600136d: Status 404 returned error can't find the container with id f3be680ca82ce4a4fe022804325fcaac08e3ba89f5ba2c190b7ccb099600136d Jul 07 06:32:40.902859 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.902774 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" event={"ID":"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae","Type":"ContainerStarted","Data":"9bc23c7dcc118356af592fa20dabb97ec64a8c5b882c1190e41d9807443699b5"} Jul 07 06:32:40.904174 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.904108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" event={"ID":"6da6b9f0-0545-485d-9c49-5dea39058520","Type":"ContainerStarted","Data":"5839490f162fc8c5572af1c0e168e1dada6eedb69f32ef5f0763546c064f32da"} Jul 07 06:32:40.905749 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.905722 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-6q8w6" event={"ID":"a6f7e13c-8773-438a-bc34-49dcd380ff4a","Type":"ContainerStarted","Data":"f3be680ca82ce4a4fe022804325fcaac08e3ba89f5ba2c190b7ccb099600136d"} Jul 07 06:32:40.907654 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.907632 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxb9r" event={"ID":"16df1bc4-8617-4445-891e-7649c7bff13e","Type":"ContainerStarted","Data":"a58e6a4abd21e081aefe350686624f2a4b5e740c228c432f1adb0f97df58888a"} Jul 07 06:32:40.908748 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.908728 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" event={"ID":"97d2346c-f029-435b-a97e-d298e8df1959","Type":"ContainerStarted","Data":"61465735a860b8c395c9cabf98497d7e3e1cc8230bbb2117e570c1ea301220cc"} Jul 07 06:32:40.910064 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:40.910023 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" event={"ID":"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6","Type":"ContainerStarted","Data":"9c9620f2fc3ac87c82fb79c0eb381be6ab619e1d12d8efc221922e8330176716"} Jul 07 06:32:41.139269 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.139217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:41.142548 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.142521 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/45c8dce0-8403-463a-80bf-e6a7c6dceed2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4q4s2\" (UID: \"45c8dce0-8403-463a-80bf-e6a7c6dceed2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:41.240393 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.240281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:41.240704 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.240683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:41.241222 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.241197 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-service-ca-bundle\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:41.247002 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.246977 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6-metrics-certs\") pod \"router-default-9cd96565c-krjmm\" (UID: \"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6\") " pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:41.354343 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.354123 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t9g8g\"" Jul 07 06:32:41.362010 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.361801 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" Jul 07 06:32:41.467782 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.467574 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jrzvv\"" Jul 07 06:32:41.474623 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.474373 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:41.569750 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.568574 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2"] Jul 07 06:32:41.575257 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:32:41.575215 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c8dce0_8403_463a_80bf_e6a7c6dceed2.slice/crio-58ca84e7aa5d0753548926d0a0080bb1053be11cb6a3221d95a9e78b3f72a581 WatchSource:0}: Error finding container 58ca84e7aa5d0753548926d0a0080bb1053be11cb6a3221d95a9e78b3f72a581: Status 404 returned error can't find the container with id 58ca84e7aa5d0753548926d0a0080bb1053be11cb6a3221d95a9e78b3f72a581 Jul 07 06:32:41.756522 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.756423 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9cd96565c-krjmm"] Jul 07 06:32:41.927108 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.927007 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" event={"ID":"45c8dce0-8403-463a-80bf-e6a7c6dceed2","Type":"ContainerStarted","Data":"58ca84e7aa5d0753548926d0a0080bb1053be11cb6a3221d95a9e78b3f72a581"} Jul 07 06:32:41.928892 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:41.928818 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9cd96565c-krjmm" event={"ID":"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6","Type":"ContainerStarted","Data":"dbc064c5ef49d2804d1ce01ef3ab09ee5e9cab55925cb3cdc3d4d8e75427c9c6"} Jul 07 06:32:42.939634 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:42.939585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9cd96565c-krjmm" event={"ID":"cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6","Type":"ContainerStarted","Data":"307c0fb5b4f72b7707095b128c2c046e50d1f798e99328e9c90702674dca343f"} Jul 07 06:32:42.962453 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:42.962399 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9cd96565c-krjmm" podStartSLOduration=33.962377319 podStartE2EDuration="33.962377319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:42.960938732 +0000 UTC m=+75.963018045" watchObservedRunningTime="2026-07-07 06:32:42.962377319 +0000 UTC m=+75.964456623" Jul 07 06:32:43.475719 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:43.475688 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:43.478583 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:43.478557 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:43.945911 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:43.945806 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:43.947477 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:43.947282 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9cd96565c-krjmm" Jul 07 06:32:51.985587 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.985550 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxb9r" event={"ID":"16df1bc4-8617-4445-891e-7649c7bff13e","Type":"ContainerStarted","Data":"64af749247d6df0f691cf01c3be8a4f9bdb37b825d58cdf56c149368243e820f"} Jul 07 06:32:51.987678 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.987645 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6pcn" event={"ID":"fd8c291f-b8db-4725-97fd-cbb92e48d483","Type":"ContainerStarted","Data":"a232b5dedbe9691ddc0647fec80647d0e70d67b540492c571f5748e85edee7e7"} Jul 07 06:32:51.987793 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.987695 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6pcn" event={"ID":"fd8c291f-b8db-4725-97fd-cbb92e48d483","Type":"ContainerStarted","Data":"e94061162d7d22f1e01bfcc823e5ce9f7c28cd930465ca9d44bedeb384bdd69d"} Jul 07 06:32:51.987793 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.987732 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l6pcn" Jul 07 06:32:51.989539 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.989181 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" event={"ID":"97d2346c-f029-435b-a97e-d298e8df1959","Type":"ContainerStarted","Data":"28a0669288410eb02f9b98ae5518456aac59f04244291ea4357940c36777553a"} Jul 07 06:32:51.991393 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.991373 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" event={"ID":"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6","Type":"ContainerStarted","Data":"c5867ed4f145bd1fc7950f7e8dad656ed903cb153b75dd73f1201115a25e7e29"} Jul 07 06:32:51.991489 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.991400 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" event={"ID":"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6","Type":"ContainerStarted","Data":"164ddcfeba3ed7cb2a3df96090fc4d8324746c7aa3ed6e91595fe7c71b97d632"} Jul 07 06:32:51.991489 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.991413 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" event={"ID":"0820bcfb-20f8-49c3-8c5f-1a0c4a821ac6","Type":"ContainerStarted","Data":"48b703bf0c4c94c9979d489df5436f4444b8826d0753f25adbbc5ee35010db08"} Jul 07 06:32:51.993216 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.993194 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" event={"ID":"45c8dce0-8403-463a-80bf-e6a7c6dceed2","Type":"ContainerStarted","Data":"0f2e22d458781c353f36b84d1a14d019e6ecb7935a2a4b352ed48f0f2d4ca426"} Jul 07 06:32:51.994856 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.994827 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" event={"ID":"9faec491-e6b7-4bc5-8faa-c2ae5cbfb1ae","Type":"ContainerStarted","Data":"b62100264652f791f9da031e9a3f49349122226efd2572d5b679bdf8d1032bad"} Jul 07 06:32:51.995202 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.995186 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:51.996690 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.996671 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" Jul 07 06:32:51.997338 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:51.997320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" event={"ID":"6da6b9f0-0545-485d-9c49-5dea39058520","Type":"ContainerStarted","Data":"b56fceacea65be870ff00fb391592d7b9e73a1d35db1879e7791e0a392ca94b2"} Jul 07 06:32:52.003945 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:52.003901 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cxb9r" podStartSLOduration=17.527035609 podStartE2EDuration="35.003889186s" totalImagesPullingTime="17.476853577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:32:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:52.003544892 +0000 UTC m=+85.005624213" watchObservedRunningTime="2026-07-07 06:32:52.003889186 +0000 UTC m=+85.005968477" Jul 07 06:32:52.021475 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:52.020372 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l6pcn" podStartSLOduration=37.308727099 podStartE2EDuration="49.020355119s" totalImagesPullingTime="11.71162802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:52.018797666 +0000 UTC m=+85.020876992" watchObservedRunningTime="2026-07-07 06:32:52.020355119 +0000 UTC m=+85.022434424" Jul 07 06:32:52.049342 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:52.049301 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4q4s2" podStartSLOduration=33.5268667 podStartE2EDuration="43.049284532s" totalImagesPullingTime="9.522417832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:52.035363405 +0000 UTC m=+85.037442718" watchObservedRunningTime="2026-07-07 06:32:52.049284532 +0000 UTC m=+85.051363845" Jul 07 06:32:52.049488 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:52.049456 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdbfb97d4-n87qm" podStartSLOduration=2.545802257 podStartE2EDuration="13.049449432s" totalImagesPullingTime="10.503647175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:52.048760624 +0000 UTC m=+85.050839938" watchObservedRunningTime="2026-07-07 06:32:52.049449432 +0000 UTC m=+85.051528746" Jul 07 06:32:52.066223 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:52.065853 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rqhct" podStartSLOduration=2.351030199 podStartE2EDuration="13.065838394s" totalImagesPullingTime="10.714808195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:52.063293126 +0000 UTC m=+85.065372440" watchObservedRunningTime="2026-07-07 06:32:52.065838394 +0000 UTC m=+85.067917708" Jul 07 06:32:52.104975 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:52.104251 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bd5dd487-6rjxn" podStartSLOduration=2.5703133620000003 podStartE2EDuration="13.104229497s" totalImagesPullingTime="10.533916135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:52.080243256 +0000 UTC m=+85.082322572" watchObservedRunningTime="2026-07-07 06:32:52.104229497 +0000 UTC m=+85.106308816" Jul 07 06:32:52.104975 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:52.104363 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c6794dcd5-qrg4h" podStartSLOduration=2.570217206 podStartE2EDuration="13.104355432s" totalImagesPullingTime="10.534138226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:32:52.102794296 +0000 UTC m=+85.104873610" watchObservedRunningTime="2026-07-07 06:32:52.104355432 +0000 UTC m=+85.106434747" Jul 07 06:32:55.967045 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:55.966997 2575 patch_prober.go:28] interesting pod/image-registry-7998b6489d-pmxvc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 06:32:55.967443 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:32:55.967094 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" podUID="699518c9-70c1-42fa-aae5-14b0a24dc49a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 06:33:00.915324 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:00.915286 2575 patch_prober.go:28] interesting pod/image-registry-7998b6489d-pmxvc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 06:33:00.915807 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:00.915350 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" podUID="699518c9-70c1-42fa-aae5-14b0a24dc49a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 06:33:01.161386 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.161353 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pkqvk"] Jul 07 06:33:01.321903 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.321873 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.330511 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.330338 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 06:33:01.330511 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.330430 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8tnd9\"" Jul 07 06:33:01.330730 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.330553 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 06:33:01.330730 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.330649 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 06:33:01.330891 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.330869 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 06:33:01.425226 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.425193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e45da2aa-c340-4006-8568-763fe9309290-sys\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.425418 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.425249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.425418 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.425285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-tls\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.425418 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.425308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-wtmp\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.425418 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.425351 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e45da2aa-c340-4006-8568-763fe9309290-metrics-client-ca\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.425589 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.425442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg4nj\" (UniqueName: \"kubernetes.io/projected/e45da2aa-c340-4006-8568-763fe9309290-kube-api-access-zg4nj\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.425589 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.425497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e45da2aa-c340-4006-8568-763fe9309290-root\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.425589 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.425531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-textfile\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.425589 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.425555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-accelerators-collector-config\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.526059 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-tls\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.526244 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-wtmp\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.526244 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e45da2aa-c340-4006-8568-763fe9309290-metrics-client-ca\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.526244 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg4nj\" (UniqueName: \"kubernetes.io/projected/e45da2aa-c340-4006-8568-763fe9309290-kube-api-access-zg4nj\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.526244 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526201 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e45da2aa-c340-4006-8568-763fe9309290-root\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.526244 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-textfile\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.526502 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526253 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-accelerators-collector-config\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.526502 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526294 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e45da2aa-c340-4006-8568-763fe9309290-sys\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.526502 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526336 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.527186 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526846 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e45da2aa-c340-4006-8568-763fe9309290-metrics-client-ca\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.527186 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526918 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-textfile\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.527186 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:33:01.526965 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 06:33:01.527186 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.526987 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e45da2aa-c340-4006-8568-763fe9309290-root\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.527186 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:33:01.527027 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-tls podName:e45da2aa-c340-4006-8568-763fe9309290 nodeName:}" failed. No retries permitted until 2026-07-07 06:33:02.027009813 +0000 UTC m=+95.029089111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-tls") pod "node-exporter-pkqvk" (UID: "e45da2aa-c340-4006-8568-763fe9309290") : secret "node-exporter-tls" not found Jul 07 06:33:01.527186 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.527027 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e45da2aa-c340-4006-8568-763fe9309290-sys\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.527186 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.527157 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-wtmp\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.527186 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.527171 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-accelerators-collector-config\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.529638 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.529612 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:01.540654 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:01.540632 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg4nj\" (UniqueName: \"kubernetes.io/projected/e45da2aa-c340-4006-8568-763fe9309290-kube-api-access-zg4nj\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:02.005357 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:02.005334 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l6pcn" Jul 07 06:33:02.031658 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:02.031602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-tls\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:02.033984 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:02.033959 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e45da2aa-c340-4006-8568-763fe9309290-node-exporter-tls\") pod \"node-exporter-pkqvk\" (UID: \"e45da2aa-c340-4006-8568-763fe9309290\") " pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:02.047610 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:02.047581 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-6q8w6" event={"ID":"a6f7e13c-8773-438a-bc34-49dcd380ff4a","Type":"ContainerStarted","Data":"784f39fbe0300b801e577e1945aa8635342a2e4c92f32068b67a328622acce5b"} Jul 07 06:33:02.047766 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:02.047747 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-6q8w6" Jul 07 06:33:02.049019 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:02.048998 2575 patch_prober.go:28] interesting pod/downloads-685bfb5f64-6q8w6 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" start-of-body= Jul 07 06:33:02.049151 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:02.049044 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-6q8w6" podUID="a6f7e13c-8773-438a-bc34-49dcd380ff4a" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" Jul 07 06:33:02.063989 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:02.063948 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-6q8w6" podStartSLOduration=1.875660375 podStartE2EDuration="23.063931542s" totalImagesPullingTime="21.188271167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:33:02.063810271 +0000 UTC m=+95.065889586" watchObservedRunningTime="2026-07-07 06:33:02.063931542 +0000 UTC m=+95.066010857" Jul 07 06:33:02.240110 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:02.240056 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pkqvk" Jul 07 06:33:02.253321 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:33:02.253294 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45da2aa_c340_4006_8568_763fe9309290.slice/crio-0f13a4601a239217bbd6429e1ae3315c50368b6f097219c1d07cb81a3c333d01 WatchSource:0}: Error finding container 0f13a4601a239217bbd6429e1ae3315c50368b6f097219c1d07cb81a3c333d01: Status 404 returned error can't find the container with id 0f13a4601a239217bbd6429e1ae3315c50368b6f097219c1d07cb81a3c333d01 Jul 07 06:33:03.056192 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:03.056150 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pkqvk" event={"ID":"e45da2aa-c340-4006-8568-763fe9309290","Type":"ContainerStarted","Data":"0f13a4601a239217bbd6429e1ae3315c50368b6f097219c1d07cb81a3c333d01"} Jul 07 06:33:03.071145 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:03.070835 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-6q8w6" Jul 07 06:33:05.080445 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:05.080409 2575 generic.go:356] "Generic (PLEG): container finished" podID="e45da2aa-c340-4006-8568-763fe9309290" containerID="c5cdf53590d43ce91bd63f285c39c9d7f1d25afae6907ddc58ae84664409bbc8" exitCode=0 Jul 07 06:33:05.081000 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:05.080471 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pkqvk" event={"ID":"e45da2aa-c340-4006-8568-763fe9309290","Type":"ContainerDied","Data":"c5cdf53590d43ce91bd63f285c39c9d7f1d25afae6907ddc58ae84664409bbc8"} Jul 07 06:33:05.874721 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:05.874691 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rcpd5" Jul 07 06:33:05.967938 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:05.967906 2575 patch_prober.go:28] interesting pod/image-registry-7998b6489d-pmxvc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 06:33:05.968229 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:05.968192 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" podUID="699518c9-70c1-42fa-aae5-14b0a24dc49a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 06:33:06.088831 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:06.088788 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pkqvk" event={"ID":"e45da2aa-c340-4006-8568-763fe9309290","Type":"ContainerStarted","Data":"0ffc3d659b40bc839298949375941a0c6de26225e8038866753efd3f07c09c8f"} Jul 07 06:33:06.089289 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:06.088848 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pkqvk" event={"ID":"e45da2aa-c340-4006-8568-763fe9309290","Type":"ContainerStarted","Data":"73dba5681beced6a4ce11fafb4cabec9a7d32eb5e3783f1fdd9ca9026ae13c77"} Jul 07 06:33:06.110538 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:06.110478 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pkqvk" podStartSLOduration=2.90604576 podStartE2EDuration="5.110456345s" totalImagesPullingTime="2.091625951s" totalInitContainerRuntime="112.784634ms" isStatefulPod=true podCreationTimestamp="2026-07-07 06:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:33:06.108961418 +0000 UTC m=+99.111040732" watchObservedRunningTime="2026-07-07 06:33:06.110456345 +0000 UTC m=+99.112535659" Jul 07 06:33:08.036997 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:08.036963 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7998b6489d-pmxvc"] Jul 07 06:33:08.042314 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:08.042278 2575 patch_prober.go:28] interesting pod/image-registry-7998b6489d-pmxvc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 06:33:08.042454 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:08.042333 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" podUID="699518c9-70c1-42fa-aae5-14b0a24dc49a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 06:33:18.042625 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:18.042597 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:33:26.557865 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:33:26.557833 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc8cd7b_bac4_4871_a061_95d3a0677d82.slice/crio-conmon-1300fb16dcbdaba425be28fc955ffcdb8ad7027c207769038b39b60cc7c379e9.scope\": RecentStats: unable to find data in memory cache]" Jul 07 06:33:27.173037 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:27.172988 2575 generic.go:356] "Generic (PLEG): container finished" podID="edc8cd7b-bac4-4871-a061-95d3a0677d82" containerID="1300fb16dcbdaba425be28fc955ffcdb8ad7027c207769038b39b60cc7c379e9" exitCode=0 Jul 07 06:33:27.173211 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:27.173052 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" event={"ID":"edc8cd7b-bac4-4871-a061-95d3a0677d82","Type":"ContainerDied","Data":"1300fb16dcbdaba425be28fc955ffcdb8ad7027c207769038b39b60cc7c379e9"} Jul 07 06:33:27.173362 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:27.173349 2575 scope.go:117] "RemoveContainer" containerID="1300fb16dcbdaba425be28fc955ffcdb8ad7027c207769038b39b60cc7c379e9" Jul 07 06:33:28.179095 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:28.179040 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-phhwv" event={"ID":"edc8cd7b-bac4-4871-a061-95d3a0677d82","Type":"ContainerStarted","Data":"d345d7400338b7d0dbda74fbabaee0ed967d390db9b8e35a149400aefac68bbc"} Jul 07 06:33:33.062971 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.062931 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" podUID="699518c9-70c1-42fa-aae5-14b0a24dc49a" containerName="registry" containerID="cri-o://c1391633c1b62c2f91ff73dd260fb9127765df0d590f8b1530c14c51c1426699" gracePeriod=30 Jul 07 06:33:33.202202 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.202167 2575 generic.go:356] "Generic (PLEG): container finished" podID="699518c9-70c1-42fa-aae5-14b0a24dc49a" containerID="c1391633c1b62c2f91ff73dd260fb9127765df0d590f8b1530c14c51c1426699" exitCode=0 Jul 07 06:33:33.202303 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.202243 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" event={"ID":"699518c9-70c1-42fa-aae5-14b0a24dc49a","Type":"ContainerDied","Data":"c1391633c1b62c2f91ff73dd260fb9127765df0d590f8b1530c14c51c1426699"} Jul 07 06:33:33.335918 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.335865 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:33:33.486823 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.486797 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-trusted-ca\") pod \"699518c9-70c1-42fa-aae5-14b0a24dc49a\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " Jul 07 06:33:33.486960 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.486831 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-bound-sa-token\") pod \"699518c9-70c1-42fa-aae5-14b0a24dc49a\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " Jul 07 06:33:33.486960 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.486850 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-installation-pull-secrets\") pod \"699518c9-70c1-42fa-aae5-14b0a24dc49a\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " Jul 07 06:33:33.486960 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.486886 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-image-registry-private-configuration\") pod \"699518c9-70c1-42fa-aae5-14b0a24dc49a\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " Jul 07 06:33:33.486960 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.486922 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c45wv\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-kube-api-access-c45wv\") pod \"699518c9-70c1-42fa-aae5-14b0a24dc49a\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " Jul 07 06:33:33.486960 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.486957 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-certificates\") pod \"699518c9-70c1-42fa-aae5-14b0a24dc49a\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " Jul 07 06:33:33.487232 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.487014 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/699518c9-70c1-42fa-aae5-14b0a24dc49a-ca-trust-extracted\") pod \"699518c9-70c1-42fa-aae5-14b0a24dc49a\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " Jul 07 06:33:33.487232 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.487046 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") pod \"699518c9-70c1-42fa-aae5-14b0a24dc49a\" (UID: \"699518c9-70c1-42fa-aae5-14b0a24dc49a\") " Jul 07 06:33:33.487344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.487254 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "699518c9-70c1-42fa-aae5-14b0a24dc49a" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 06:33:33.487344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.487327 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-trusted-ca\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:33:33.487512 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.487486 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "699518c9-70c1-42fa-aae5-14b0a24dc49a" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 06:33:33.489629 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.489587 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "699518c9-70c1-42fa-aae5-14b0a24dc49a" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:33:33.489812 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.489784 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-kube-api-access-c45wv" (OuterVolumeSpecName: "kube-api-access-c45wv") pod "699518c9-70c1-42fa-aae5-14b0a24dc49a" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a"). InnerVolumeSpecName "kube-api-access-c45wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:33:33.489812 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.489792 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "699518c9-70c1-42fa-aae5-14b0a24dc49a" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 06:33:33.489906 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.489842 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "699518c9-70c1-42fa-aae5-14b0a24dc49a" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:33:33.490244 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.490222 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "699518c9-70c1-42fa-aae5-14b0a24dc49a" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 06:33:33.495800 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.495774 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/699518c9-70c1-42fa-aae5-14b0a24dc49a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "699518c9-70c1-42fa-aae5-14b0a24dc49a" (UID: "699518c9-70c1-42fa-aae5-14b0a24dc49a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 06:33:33.587839 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.587789 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-certificates\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:33:33.587839 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.587809 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/699518c9-70c1-42fa-aae5-14b0a24dc49a-ca-trust-extracted\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:33:33.587839 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.587819 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-registry-tls\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:33:33.587839 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.587827 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-bound-sa-token\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:33:33.587839 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.587835 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-installation-pull-secrets\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:33:33.588035 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.587844 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/699518c9-70c1-42fa-aae5-14b0a24dc49a-image-registry-private-configuration\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:33:33.588035 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:33.587853 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c45wv\" (UniqueName: \"kubernetes.io/projected/699518c9-70c1-42fa-aae5-14b0a24dc49a-kube-api-access-c45wv\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:33:34.206709 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:34.206682 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" Jul 07 06:33:34.206709 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:34.206694 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7998b6489d-pmxvc" event={"ID":"699518c9-70c1-42fa-aae5-14b0a24dc49a","Type":"ContainerDied","Data":"2ded543c8aa7394bb2bf94ef7bd28b34efdfbd8e17f7056a10cc78ea356b06b0"} Jul 07 06:33:34.207286 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:34.206753 2575 scope.go:117] "RemoveContainer" containerID="c1391633c1b62c2f91ff73dd260fb9127765df0d590f8b1530c14c51c1426699" Jul 07 06:33:34.224706 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:34.224684 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7998b6489d-pmxvc"] Jul 07 06:33:34.228870 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:34.228849 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7998b6489d-pmxvc"] Jul 07 06:33:35.526908 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:35.526878 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="699518c9-70c1-42fa-aae5-14b0a24dc49a" path="/var/lib/kubelet/pods/699518c9-70c1-42fa-aae5-14b0a24dc49a/volumes" Jul 07 06:33:37.220270 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:37.220234 2575 generic.go:356] "Generic (PLEG): container finished" podID="afb4af7c-3cca-4635-afde-dbb8e92d2664" containerID="a0699475df370e2d2fb23533bbd332e1b41e01ea463dbff3f9b15349a4bc4f41" exitCode=0 Jul 07 06:33:37.220624 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:37.220283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" event={"ID":"afb4af7c-3cca-4635-afde-dbb8e92d2664","Type":"ContainerDied","Data":"a0699475df370e2d2fb23533bbd332e1b41e01ea463dbff3f9b15349a4bc4f41"} Jul 07 06:33:37.220674 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:37.220641 2575 scope.go:117] "RemoveContainer" containerID="a0699475df370e2d2fb23533bbd332e1b41e01ea463dbff3f9b15349a4bc4f41" Jul 07 06:33:38.226266 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:38.226230 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2rvvr" event={"ID":"afb4af7c-3cca-4635-afde-dbb8e92d2664","Type":"ContainerStarted","Data":"9d633a50801fbaf09b2cb68e1706a12c1fb1b5097b42552b195200184f1ef5cd"} Jul 07 06:33:48.264924 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:48.264889 2575 generic.go:356] "Generic (PLEG): container finished" podID="f0cf7c7a-b953-48f5-9e11-a579660d707f" containerID="9f94d32e00b1daaa95993d2f861fd55e4099b7a53d0e8daa6353f236ca7b7023" exitCode=0 Jul 07 06:33:48.265344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:48.264951 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" event={"ID":"f0cf7c7a-b953-48f5-9e11-a579660d707f","Type":"ContainerDied","Data":"9f94d32e00b1daaa95993d2f861fd55e4099b7a53d0e8daa6353f236ca7b7023"} Jul 07 06:33:48.265344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:48.265299 2575 scope.go:117] "RemoveContainer" containerID="9f94d32e00b1daaa95993d2f861fd55e4099b7a53d0e8daa6353f236ca7b7023" Jul 07 06:33:49.272435 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:33:49.272404 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kdbpq" event={"ID":"f0cf7c7a-b953-48f5-9e11-a579660d707f","Type":"ContainerStarted","Data":"00aef7709c415b2c3270a5037ad26d994e15f067fcb9f29ed23ab77444079da4"} Jul 07 06:36:27.425267 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:27.425231 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:36:27.437567 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:27.437544 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 06:36:27.440303 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:27.440277 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:36:30.546344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.546312 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9"] Jul 07 06:36:30.548639 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.546589 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="699518c9-70c1-42fa-aae5-14b0a24dc49a" containerName="registry" Jul 07 06:36:30.548639 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.546600 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="699518c9-70c1-42fa-aae5-14b0a24dc49a" containerName="registry" Jul 07 06:36:30.548639 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.546657 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="699518c9-70c1-42fa-aae5-14b0a24dc49a" containerName="registry" Jul 07 06:36:30.549566 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.549549 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.552420 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.552397 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 06:36:30.552899 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.552882 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 06:36:30.552977 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.552931 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 06:36:30.553019 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.552972 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mhfqd\"" Jul 07 06:36:30.553416 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.553399 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 06:36:30.579191 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.579170 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9"] Jul 07 06:36:30.646634 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.646605 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d729752d-06f0-4c3e-afc3-af5471659a1f-manifests\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.646766 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.646651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d729752d-06f0-4c3e-afc3-af5471659a1f-tmp\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.646766 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.646694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdvsh\" (UniqueName: \"kubernetes.io/projected/d729752d-06f0-4c3e-afc3-af5471659a1f-kube-api-access-qdvsh\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.646766 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.646728 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d729752d-06f0-4c3e-afc3-af5471659a1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.646898 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.646809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d729752d-06f0-4c3e-afc3-af5471659a1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.747416 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.747375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d729752d-06f0-4c3e-afc3-af5471659a1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.747541 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.747429 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d729752d-06f0-4c3e-afc3-af5471659a1f-manifests\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.747541 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.747454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d729752d-06f0-4c3e-afc3-af5471659a1f-tmp\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.747541 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.747479 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdvsh\" (UniqueName: \"kubernetes.io/projected/d729752d-06f0-4c3e-afc3-af5471659a1f-kube-api-access-qdvsh\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.747541 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.747500 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d729752d-06f0-4c3e-afc3-af5471659a1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.747929 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.747899 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d729752d-06f0-4c3e-afc3-af5471659a1f-manifests\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.749828 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.749800 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d729752d-06f0-4c3e-afc3-af5471659a1f-tmp\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.749924 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.749842 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d729752d-06f0-4c3e-afc3-af5471659a1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.749966 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.749932 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d729752d-06f0-4c3e-afc3-af5471659a1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.757736 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.757712 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdvsh\" (UniqueName: \"kubernetes.io/projected/d729752d-06f0-4c3e-afc3-af5471659a1f-kube-api-access-qdvsh\") pod \"opendatahub-operator-controller-manager-c66c8b568-7vdv9\" (UID: \"d729752d-06f0-4c3e-afc3-af5471659a1f\") " pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.860091 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.860016 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:30.992859 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.992831 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9"] Jul 07 06:36:30.995329 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:36:30.995295 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd729752d_06f0_4c3e_afc3_af5471659a1f.slice/crio-d1e5c6d9e19b9db0ae2bc6b3eb44e8da0575146e10b1d2b19ffa05c61ecfbbd3 WatchSource:0}: Error finding container d1e5c6d9e19b9db0ae2bc6b3eb44e8da0575146e10b1d2b19ffa05c61ecfbbd3: Status 404 returned error can't find the container with id d1e5c6d9e19b9db0ae2bc6b3eb44e8da0575146e10b1d2b19ffa05c61ecfbbd3 Jul 07 06:36:30.997063 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:30.997048 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 06:36:31.892263 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:31.892214 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" event={"ID":"d729752d-06f0-4c3e-afc3-af5471659a1f","Type":"ContainerStarted","Data":"d1e5c6d9e19b9db0ae2bc6b3eb44e8da0575146e10b1d2b19ffa05c61ecfbbd3"} Jul 07 06:36:34.906966 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:34.906928 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" event={"ID":"d729752d-06f0-4c3e-afc3-af5471659a1f","Type":"ContainerStarted","Data":"d3e945aea9115ad2c9474baca3595a7098a8e9243ba1472f8c2e0f4c92eb4b8e"} Jul 07 06:36:35.912733 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:35.912698 2575 generic.go:356] "Generic (PLEG): container finished" podID="d729752d-06f0-4c3e-afc3-af5471659a1f" containerID="d3e945aea9115ad2c9474baca3595a7098a8e9243ba1472f8c2e0f4c92eb4b8e" exitCode=0 Jul 07 06:36:35.913217 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:35.912749 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" event={"ID":"d729752d-06f0-4c3e-afc3-af5471659a1f","Type":"ContainerDied","Data":"d3e945aea9115ad2c9474baca3595a7098a8e9243ba1472f8c2e0f4c92eb4b8e"} Jul 07 06:36:36.920010 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:36.919975 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" event={"ID":"d729752d-06f0-4c3e-afc3-af5471659a1f","Type":"ContainerStarted","Data":"96af8a50019cbd2289d46b2d35703c1210c5a5023951482fb54323c5123ca4bc"} Jul 07 06:36:36.920492 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:36.920231 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:36.943847 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:36.943800 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" podStartSLOduration=2.546861898 podStartE2EDuration="6.943786193s" totalImagesPullingTime="3.395177185s" totalInitContainerRuntime="1.00174711s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:36:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:36:36.942497136 +0000 UTC m=+309.944576450" watchObservedRunningTime="2026-07-07 06:36:36.943786193 +0000 UTC m=+309.945865505" Jul 07 06:36:47.926402 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:47.926374 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c66c8b568-7vdv9" Jul 07 06:36:50.369561 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.369526 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74994db979-dhb5f"] Jul 07 06:36:50.372940 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.372919 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.377100 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.377065 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 06:36:50.377224 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.377206 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gdh9s\"" Jul 07 06:36:50.378227 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.378209 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 06:36:50.397256 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.397227 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74994db979-dhb5f"] Jul 07 06:36:50.503757 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.503725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/903ff31c-72f6-4d9c-99e7-c6c09d7ef574-tmp\") pod \"kube-auth-proxy-74994db979-dhb5f\" (UID: \"903ff31c-72f6-4d9c-99e7-c6c09d7ef574\") " pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.503757 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.503753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkclk\" (UniqueName: \"kubernetes.io/projected/903ff31c-72f6-4d9c-99e7-c6c09d7ef574-kube-api-access-nkclk\") pod \"kube-auth-proxy-74994db979-dhb5f\" (UID: \"903ff31c-72f6-4d9c-99e7-c6c09d7ef574\") " pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.503977 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.503795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903ff31c-72f6-4d9c-99e7-c6c09d7ef574-tls-certs\") pod \"kube-auth-proxy-74994db979-dhb5f\" (UID: \"903ff31c-72f6-4d9c-99e7-c6c09d7ef574\") " pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.604432 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.604392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903ff31c-72f6-4d9c-99e7-c6c09d7ef574-tls-certs\") pod \"kube-auth-proxy-74994db979-dhb5f\" (UID: \"903ff31c-72f6-4d9c-99e7-c6c09d7ef574\") " pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.604598 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.604453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/903ff31c-72f6-4d9c-99e7-c6c09d7ef574-tmp\") pod \"kube-auth-proxy-74994db979-dhb5f\" (UID: \"903ff31c-72f6-4d9c-99e7-c6c09d7ef574\") " pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.604598 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.604475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkclk\" (UniqueName: \"kubernetes.io/projected/903ff31c-72f6-4d9c-99e7-c6c09d7ef574-kube-api-access-nkclk\") pod \"kube-auth-proxy-74994db979-dhb5f\" (UID: \"903ff31c-72f6-4d9c-99e7-c6c09d7ef574\") " pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.606772 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.606744 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/903ff31c-72f6-4d9c-99e7-c6c09d7ef574-tmp\") pod \"kube-auth-proxy-74994db979-dhb5f\" (UID: \"903ff31c-72f6-4d9c-99e7-c6c09d7ef574\") " pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.606885 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.606869 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903ff31c-72f6-4d9c-99e7-c6c09d7ef574-tls-certs\") pod \"kube-auth-proxy-74994db979-dhb5f\" (UID: \"903ff31c-72f6-4d9c-99e7-c6c09d7ef574\") " pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.622103 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.622006 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkclk\" (UniqueName: \"kubernetes.io/projected/903ff31c-72f6-4d9c-99e7-c6c09d7ef574-kube-api-access-nkclk\") pod \"kube-auth-proxy-74994db979-dhb5f\" (UID: \"903ff31c-72f6-4d9c-99e7-c6c09d7ef574\") " pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.682250 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.682226 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" Jul 07 06:36:50.838119 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.838096 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74994db979-dhb5f"] Jul 07 06:36:50.840435 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:36:50.840411 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903ff31c_72f6_4d9c_99e7_c6c09d7ef574.slice/crio-a69ac22701165cdfd9adec7e72937491b1579c95379dce4dea266565dafa484d WatchSource:0}: Error finding container a69ac22701165cdfd9adec7e72937491b1579c95379dce4dea266565dafa484d: Status 404 returned error can't find the container with id a69ac22701165cdfd9adec7e72937491b1579c95379dce4dea266565dafa484d Jul 07 06:36:50.873651 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.873602 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dsndp"] Jul 07 06:36:50.878067 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.878051 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:36:50.880832 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.880808 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-924kc\"" Jul 07 06:36:50.880832 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.880815 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 06:36:50.896118 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.896097 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dsndp"] Jul 07 06:36:50.982300 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:50.982267 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" event={"ID":"903ff31c-72f6-4d9c-99e7-c6c09d7ef574","Type":"ContainerStarted","Data":"a69ac22701165cdfd9adec7e72937491b1579c95379dce4dea266565dafa484d"} Jul 07 06:36:51.008164 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:51.008132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh7d2\" (UniqueName: \"kubernetes.io/projected/41f4a357-bbcb-4450-8af7-b25d3a8e555c-kube-api-access-qh7d2\") pod \"odh-model-controller-7998c67dc4-dsndp\" (UID: \"41f4a357-bbcb-4450-8af7-b25d3a8e555c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:36:51.008344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:51.008190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41f4a357-bbcb-4450-8af7-b25d3a8e555c-cert\") pod \"odh-model-controller-7998c67dc4-dsndp\" (UID: \"41f4a357-bbcb-4450-8af7-b25d3a8e555c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:36:51.109587 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:51.109546 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh7d2\" (UniqueName: \"kubernetes.io/projected/41f4a357-bbcb-4450-8af7-b25d3a8e555c-kube-api-access-qh7d2\") pod \"odh-model-controller-7998c67dc4-dsndp\" (UID: \"41f4a357-bbcb-4450-8af7-b25d3a8e555c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:36:51.109766 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:51.109625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41f4a357-bbcb-4450-8af7-b25d3a8e555c-cert\") pod \"odh-model-controller-7998c67dc4-dsndp\" (UID: \"41f4a357-bbcb-4450-8af7-b25d3a8e555c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:36:51.109846 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:36:51.109789 2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 07 06:36:51.109901 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:36:51.109883 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41f4a357-bbcb-4450-8af7-b25d3a8e555c-cert podName:41f4a357-bbcb-4450-8af7-b25d3a8e555c nodeName:}" failed. No retries permitted until 2026-07-07 06:36:51.609859995 +0000 UTC m=+324.611939292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/41f4a357-bbcb-4450-8af7-b25d3a8e555c-cert") pod "odh-model-controller-7998c67dc4-dsndp" (UID: "41f4a357-bbcb-4450-8af7-b25d3a8e555c") : secret "odh-model-controller-webhook-cert" not found Jul 07 06:36:51.134879 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:51.134806 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh7d2\" (UniqueName: \"kubernetes.io/projected/41f4a357-bbcb-4450-8af7-b25d3a8e555c-kube-api-access-qh7d2\") pod \"odh-model-controller-7998c67dc4-dsndp\" (UID: \"41f4a357-bbcb-4450-8af7-b25d3a8e555c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:36:51.613854 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:51.613823 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41f4a357-bbcb-4450-8af7-b25d3a8e555c-cert\") pod \"odh-model-controller-7998c67dc4-dsndp\" (UID: \"41f4a357-bbcb-4450-8af7-b25d3a8e555c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:36:51.617463 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:51.617436 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41f4a357-bbcb-4450-8af7-b25d3a8e555c-cert\") pod \"odh-model-controller-7998c67dc4-dsndp\" (UID: \"41f4a357-bbcb-4450-8af7-b25d3a8e555c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:36:51.790155 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:51.790121 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:36:51.946235 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:51.946203 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dsndp"] Jul 07 06:36:51.949470 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:36:51.949441 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f4a357_bbcb_4450_8af7_b25d3a8e555c.slice/crio-875ce91e2eea1ba0f8922d0abc47462392062c08dfac4eef8fc41b7db35e1053 WatchSource:0}: Error finding container 875ce91e2eea1ba0f8922d0abc47462392062c08dfac4eef8fc41b7db35e1053: Status 404 returned error can't find the container with id 875ce91e2eea1ba0f8922d0abc47462392062c08dfac4eef8fc41b7db35e1053 Jul 07 06:36:51.998027 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:51.997924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" event={"ID":"41f4a357-bbcb-4450-8af7-b25d3a8e555c","Type":"ContainerStarted","Data":"875ce91e2eea1ba0f8922d0abc47462392062c08dfac4eef8fc41b7db35e1053"} Jul 07 06:36:52.258593 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.258555 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2zzfh"] Jul 07 06:36:52.263571 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.263547 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" Jul 07 06:36:52.269106 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.268759 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 06:36:52.277924 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.277884 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2zzfh"] Jul 07 06:36:52.345523 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.345478 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm"] Jul 07 06:36:52.348991 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.348971 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.352325 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.352168 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 06:36:52.352325 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.352189 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 06:36:52.352325 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.352202 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cljnv\"" Jul 07 06:36:52.352325 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.352231 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 06:36:52.352906 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.352888 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 06:36:52.367235 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.367212 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm"] Jul 07 06:36:52.422170 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.422138 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-cacerts\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.422354 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.422208 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-token\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.422354 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.422264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.422354 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.422309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9qrn\" (UniqueName: \"kubernetes.io/projected/b5a46271-f02e-4705-8ef4-4557ec55ed97-kube-api-access-q9qrn\") pod \"model-serving-api-54d89bd5fc-2zzfh\" (UID: \"b5a46271-f02e-4705-8ef4-4557ec55ed97\") " pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" Jul 07 06:36:52.422354 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.422338 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a46271-f02e-4705-8ef4-4557ec55ed97-tls-certs\") pod \"model-serving-api-54d89bd5fc-2zzfh\" (UID: \"b5a46271-f02e-4705-8ef4-4557ec55ed97\") " pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" Jul 07 06:36:52.422585 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.422362 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.422585 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.422416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.422585 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.422449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-local-certs\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.422585 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.422483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvknf\" (UniqueName: \"kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-kube-api-access-fvknf\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.523941 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.523848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.523941 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.523895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-local-certs\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.523941 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.523927 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvknf\" (UniqueName: \"kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-kube-api-access-fvknf\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.524259 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.523963 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-cacerts\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.524259 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.524012 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-token\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.524259 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.524044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.524259 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.524093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9qrn\" (UniqueName: \"kubernetes.io/projected/b5a46271-f02e-4705-8ef4-4557ec55ed97-kube-api-access-q9qrn\") pod \"model-serving-api-54d89bd5fc-2zzfh\" (UID: \"b5a46271-f02e-4705-8ef4-4557ec55ed97\") " pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" Jul 07 06:36:52.524259 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.524123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a46271-f02e-4705-8ef4-4557ec55ed97-tls-certs\") pod \"model-serving-api-54d89bd5fc-2zzfh\" (UID: \"b5a46271-f02e-4705-8ef4-4557ec55ed97\") " pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" Jul 07 06:36:52.524259 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.524148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.525229 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.525140 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.526873 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.526826 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.527361 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.527316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-cacerts\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.528429 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.527652 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-local-certs\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.528429 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.528117 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a46271-f02e-4705-8ef4-4557ec55ed97-tls-certs\") pod \"model-serving-api-54d89bd5fc-2zzfh\" (UID: \"b5a46271-f02e-4705-8ef4-4557ec55ed97\") " pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" Jul 07 06:36:52.528429 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.528397 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.533355 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.533326 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-token\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.533474 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.533454 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9qrn\" (UniqueName: \"kubernetes.io/projected/b5a46271-f02e-4705-8ef4-4557ec55ed97-kube-api-access-q9qrn\") pod \"model-serving-api-54d89bd5fc-2zzfh\" (UID: \"b5a46271-f02e-4705-8ef4-4557ec55ed97\") " pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" Jul 07 06:36:52.533743 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.533727 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvknf\" (UniqueName: \"kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-kube-api-access-fvknf\") pod \"istiod-openshift-gateway-7574459656-4xdcm\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.577981 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.577958 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" Jul 07 06:36:52.660274 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.660244 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:52.751461 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.751377 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2zzfh"] Jul 07 06:36:52.758497 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:36:52.758462 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a46271_f02e_4705_8ef4_4557ec55ed97.slice/crio-939288639c655c3f32422937d8ce0ad57f044d123b266fd4c565a6c517080eb4 WatchSource:0}: Error finding container 939288639c655c3f32422937d8ce0ad57f044d123b266fd4c565a6c517080eb4: Status 404 returned error can't find the container with id 939288639c655c3f32422937d8ce0ad57f044d123b266fd4c565a6c517080eb4 Jul 07 06:36:52.858730 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:52.858697 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm"] Jul 07 06:36:52.860001 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:36:52.859969 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7983b3_f0b1_4cce_955a_d28964e9e0a2.slice/crio-74e0566e1e41fe9c4b0c4cee3223249456f7c54dfe7cec9b6c448b40c26f52e8 WatchSource:0}: Error finding container 74e0566e1e41fe9c4b0c4cee3223249456f7c54dfe7cec9b6c448b40c26f52e8: Status 404 returned error can't find the container with id 74e0566e1e41fe9c4b0c4cee3223249456f7c54dfe7cec9b6c448b40c26f52e8 Jul 07 06:36:53.006732 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:53.006643 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" event={"ID":"1c7983b3-f0b1-4cce-955a-d28964e9e0a2","Type":"ContainerStarted","Data":"74e0566e1e41fe9c4b0c4cee3223249456f7c54dfe7cec9b6c448b40c26f52e8"} Jul 07 06:36:53.008227 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:53.008187 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" event={"ID":"b5a46271-f02e-4705-8ef4-4557ec55ed97","Type":"ContainerStarted","Data":"939288639c655c3f32422937d8ce0ad57f044d123b266fd4c565a6c517080eb4"} Jul 07 06:36:57.029509 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:57.029469 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 06:36:57.029920 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:57.029553 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 06:36:58.038824 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.038778 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" event={"ID":"b5a46271-f02e-4705-8ef4-4557ec55ed97","Type":"ContainerStarted","Data":"a1107245f635be6df86a06763b0d0e8ff7a342db969333f229834ded7146d1ae"} Jul 07 06:36:58.039278 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.038949 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" Jul 07 06:36:58.040363 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.040325 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" event={"ID":"903ff31c-72f6-4d9c-99e7-c6c09d7ef574","Type":"ContainerStarted","Data":"2ce8efc111ef6e80282c0bdaffb47c704801cc97ce08f8bff7a5aac4ce590682"} Jul 07 06:36:58.041889 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.041861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" event={"ID":"1c7983b3-f0b1-4cce-955a-d28964e9e0a2","Type":"ContainerStarted","Data":"29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3"} Jul 07 06:36:58.042064 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.042042 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:36:58.043488 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.043467 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" event={"ID":"41f4a357-bbcb-4450-8af7-b25d3a8e555c","Type":"ContainerStarted","Data":"d0e23fcb8a70ff5a8f169540919105e1447966fc9d58cb9f6690b48bcd96ccdb"} Jul 07 06:36:58.043614 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.043602 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:36:58.043839 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.043817 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-4xdcm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 06:36:58.043952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.043877 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" podUID="1c7983b3-f0b1-4cce-955a-d28964e9e0a2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 06:36:58.059957 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.059909 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" podStartSLOduration=1.788577664 podStartE2EDuration="6.059896254s" totalImagesPullingTime="4.27131859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:36:58.057935851 +0000 UTC m=+331.060015165" watchObservedRunningTime="2026-07-07 06:36:58.059896254 +0000 UTC m=+331.061975565" Jul 07 06:36:58.076982 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.076939 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" podStartSLOduration=3.005000289 podStartE2EDuration="8.076930566s" totalImagesPullingTime="5.071930277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:36:58.075177031 +0000 UTC m=+331.077256342" watchObservedRunningTime="2026-07-07 06:36:58.076930566 +0000 UTC m=+331.079009909" Jul 07 06:36:58.096762 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.096721 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" podStartSLOduration=1.929956946 podStartE2EDuration="6.096708579s" totalImagesPullingTime="4.166751633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:36:58.095292991 +0000 UTC m=+331.097372303" watchObservedRunningTime="2026-07-07 06:36:58.096708579 +0000 UTC m=+331.098787892" Jul 07 06:36:58.115207 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:58.115155 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74994db979-dhb5f" podStartSLOduration=1.997408931 podStartE2EDuration="8.115139095s" totalImagesPullingTime="6.117730164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:36:58.113525194 +0000 UTC m=+331.115604508" watchObservedRunningTime="2026-07-07 06:36:58.115139095 +0000 UTC m=+331.117218407" Jul 07 06:36:59.049104 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:36:59.049048 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:37:02.583350 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.583307 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk"] Jul 07 06:37:02.587305 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.587280 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" Jul 07 06:37:02.590122 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.590103 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bbtgd\"" Jul 07 06:37:02.590277 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.590259 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 06:37:02.601921 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.601898 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk"] Jul 07 06:37:02.723588 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.723546 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5spn\" (UniqueName: \"kubernetes.io/projected/2551a29f-1db7-47e3-94d8-c4ea86eb47e1-kube-api-access-w5spn\") pod \"kserve-controller-manager-d6f4b65b8-sfpvk\" (UID: \"2551a29f-1db7-47e3-94d8-c4ea86eb47e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" Jul 07 06:37:02.723769 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.723597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2551a29f-1db7-47e3-94d8-c4ea86eb47e1-cert\") pod \"kserve-controller-manager-d6f4b65b8-sfpvk\" (UID: \"2551a29f-1db7-47e3-94d8-c4ea86eb47e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" Jul 07 06:37:02.824675 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.824641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5spn\" (UniqueName: \"kubernetes.io/projected/2551a29f-1db7-47e3-94d8-c4ea86eb47e1-kube-api-access-w5spn\") pod \"kserve-controller-manager-d6f4b65b8-sfpvk\" (UID: \"2551a29f-1db7-47e3-94d8-c4ea86eb47e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" Jul 07 06:37:02.824867 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.824683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2551a29f-1db7-47e3-94d8-c4ea86eb47e1-cert\") pod \"kserve-controller-manager-d6f4b65b8-sfpvk\" (UID: \"2551a29f-1db7-47e3-94d8-c4ea86eb47e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" Jul 07 06:37:02.827300 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.827279 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2551a29f-1db7-47e3-94d8-c4ea86eb47e1-cert\") pod \"kserve-controller-manager-d6f4b65b8-sfpvk\" (UID: \"2551a29f-1db7-47e3-94d8-c4ea86eb47e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" Jul 07 06:37:02.837906 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.837855 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5spn\" (UniqueName: \"kubernetes.io/projected/2551a29f-1db7-47e3-94d8-c4ea86eb47e1-kube-api-access-w5spn\") pod \"kserve-controller-manager-d6f4b65b8-sfpvk\" (UID: \"2551a29f-1db7-47e3-94d8-c4ea86eb47e1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" Jul 07 06:37:02.898864 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:02.898829 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" Jul 07 06:37:03.034119 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:03.034098 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk"] Jul 07 06:37:03.036703 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:37:03.036659 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2551a29f_1db7_47e3_94d8_c4ea86eb47e1.slice/crio-15f1f32aa825bd404a3951828416e6b1b32af6c34138dfcd194ae00d5c8eebe4 WatchSource:0}: Error finding container 15f1f32aa825bd404a3951828416e6b1b32af6c34138dfcd194ae00d5c8eebe4: Status 404 returned error can't find the container with id 15f1f32aa825bd404a3951828416e6b1b32af6c34138dfcd194ae00d5c8eebe4 Jul 07 06:37:03.067547 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:03.067519 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" event={"ID":"2551a29f-1db7-47e3-94d8-c4ea86eb47e1","Type":"ContainerStarted","Data":"15f1f32aa825bd404a3951828416e6b1b32af6c34138dfcd194ae00d5c8eebe4"} Jul 07 06:37:05.159430 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.159394 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm"] Jul 07 06:37:05.159850 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.159661 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" podUID="1c7983b3-f0b1-4cce-955a-d28964e9e0a2" containerName="discovery" containerID="cri-o://29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3" gracePeriod=30 Jul 07 06:37:05.709693 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.709671 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:37:05.852525 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.852451 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-local-certs\") pod \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " Jul 07 06:37:05.852525 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.852507 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-token\") pod \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " Jul 07 06:37:05.852692 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.852526 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-kubeconfig\") pod \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " Jul 07 06:37:05.852692 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.852638 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvknf\" (UniqueName: \"kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-kube-api-access-fvknf\") pod \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " Jul 07 06:37:05.852772 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.852733 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-dns-cert\") pod \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " Jul 07 06:37:05.852818 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.852783 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-cacerts\") pod \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " Jul 07 06:37:05.852818 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.852808 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-ca-configmap\") pod \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\" (UID: \"1c7983b3-f0b1-4cce-955a-d28964e9e0a2\") " Jul 07 06:37:05.853595 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.853547 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1c7983b3-f0b1-4cce-955a-d28964e9e0a2" (UID: "1c7983b3-f0b1-4cce-955a-d28964e9e0a2"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 06:37:05.855313 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.855266 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1c7983b3-f0b1-4cce-955a-d28964e9e0a2" (UID: "1c7983b3-f0b1-4cce-955a-d28964e9e0a2"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 06:37:05.855313 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.855302 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-kube-api-access-fvknf" (OuterVolumeSpecName: "kube-api-access-fvknf") pod "1c7983b3-f0b1-4cce-955a-d28964e9e0a2" (UID: "1c7983b3-f0b1-4cce-955a-d28964e9e0a2"). InnerVolumeSpecName "kube-api-access-fvknf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:37:05.855432 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.855323 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c7983b3-f0b1-4cce-955a-d28964e9e0a2" (UID: "1c7983b3-f0b1-4cce-955a-d28964e9e0a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:37:05.855432 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.855322 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-cacerts" (OuterVolumeSpecName: "cacerts") pod "1c7983b3-f0b1-4cce-955a-d28964e9e0a2" (UID: "1c7983b3-f0b1-4cce-955a-d28964e9e0a2"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 06:37:05.855432 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.855352 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1c7983b3-f0b1-4cce-955a-d28964e9e0a2" (UID: "1c7983b3-f0b1-4cce-955a-d28964e9e0a2"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 06:37:05.855432 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.855381 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-local-certs" (OuterVolumeSpecName: "local-certs") pod "1c7983b3-f0b1-4cce-955a-d28964e9e0a2" (UID: "1c7983b3-f0b1-4cce-955a-d28964e9e0a2"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 06:37:05.953678 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.953648 2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-kubeconfig\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:37:05.953678 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.953677 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvknf\" (UniqueName: \"kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-kube-api-access-fvknf\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:37:05.953882 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.953689 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-dns-cert\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:37:05.953882 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.953701 2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-cacerts\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:37:05.953882 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.953713 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-csr-ca-configmap\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:37:05.953882 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.953725 2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-local-certs\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:37:05.953882 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:05.953735 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c7983b3-f0b1-4cce-955a-d28964e9e0a2-istio-token\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:37:06.094407 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.094363 2575 generic.go:356] "Generic (PLEG): container finished" podID="1c7983b3-f0b1-4cce-955a-d28964e9e0a2" containerID="29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3" exitCode=0 Jul 07 06:37:06.094603 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.094523 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" event={"ID":"1c7983b3-f0b1-4cce-955a-d28964e9e0a2","Type":"ContainerDied","Data":"29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3"} Jul 07 06:37:06.094603 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.094574 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" event={"ID":"1c7983b3-f0b1-4cce-955a-d28964e9e0a2","Type":"ContainerDied","Data":"74e0566e1e41fe9c4b0c4cee3223249456f7c54dfe7cec9b6c448b40c26f52e8"} Jul 07 06:37:06.094769 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.094603 2575 scope.go:117] "RemoveContainer" containerID="29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3" Jul 07 06:37:06.094819 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.094768 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm" Jul 07 06:37:06.102602 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.102532 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" event={"ID":"2551a29f-1db7-47e3-94d8-c4ea86eb47e1","Type":"ContainerStarted","Data":"99715c875033a1dad5de0aeaef3f741b86aef1ded15c3767786f5e666e8b7d3c"} Jul 07 06:37:06.102749 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.102690 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" Jul 07 06:37:06.107163 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.107147 2575 scope.go:117] "RemoveContainer" containerID="29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3" Jul 07 06:37:06.107445 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:37:06.107422 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3\": container with ID starting with 29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3 not found: ID does not exist" containerID="29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3" Jul 07 06:37:06.107494 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.107453 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3"} err="failed to get container status \"29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3\": rpc error: code = NotFound desc = could not find container \"29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3\": container with ID starting with 29e4cdfa14b73048c30aa6c3a9b260be69378e73c202d3d17cc284cd68b68dc3 not found: ID does not exist" Jul 07 06:37:06.135306 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.135264 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" podStartSLOduration=1.560120317 podStartE2EDuration="4.135250439s" totalImagesPullingTime="2.575130122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:37:06.134130779 +0000 UTC m=+339.136210093" watchObservedRunningTime="2026-07-07 06:37:06.135250439 +0000 UTC m=+339.137329754" Jul 07 06:37:06.166067 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.166043 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm"] Jul 07 06:37:06.174145 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:06.174124 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4xdcm"] Jul 07 06:37:07.528660 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:07.528622 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c7983b3-f0b1-4cce-955a-d28964e9e0a2" path="/var/lib/kubelet/pods/1c7983b3-f0b1-4cce-955a-d28964e9e0a2/volumes" Jul 07 06:37:09.050673 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:09.050645 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dsndp" Jul 07 06:37:09.052569 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:09.052548 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-2zzfh" Jul 07 06:37:37.114635 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:37.114603 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sfpvk" Jul 07 06:37:51.593304 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.593271 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtw6g"] Jul 07 06:37:51.593655 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.593593 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c7983b3-f0b1-4cce-955a-d28964e9e0a2" containerName="discovery" Jul 07 06:37:51.593655 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.593605 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c7983b3-f0b1-4cce-955a-d28964e9e0a2" containerName="discovery" Jul 07 06:37:51.593730 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.593667 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c7983b3-f0b1-4cce-955a-d28964e9e0a2" containerName="discovery" Jul 07 06:37:51.596561 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.596543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" Jul 07 06:37:51.599461 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.599434 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rsgqg\"" Jul 07 06:37:51.599573 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.599499 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 06:37:51.599573 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.599549 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 06:37:51.607672 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.607645 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtw6g"] Jul 07 06:37:51.704430 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.704400 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4gh5\" (UniqueName: \"kubernetes.io/projected/fbe24664-3cbf-45fe-96e1-11200c84cd9e-kube-api-access-n4gh5\") pod \"kuadrant-operator-catalog-dtw6g\" (UID: \"fbe24664-3cbf-45fe-96e1-11200c84cd9e\") " pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" Jul 07 06:37:51.805245 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.805220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4gh5\" (UniqueName: \"kubernetes.io/projected/fbe24664-3cbf-45fe-96e1-11200c84cd9e-kube-api-access-n4gh5\") pod \"kuadrant-operator-catalog-dtw6g\" (UID: \"fbe24664-3cbf-45fe-96e1-11200c84cd9e\") " pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" Jul 07 06:37:51.814424 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.814396 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4gh5\" (UniqueName: \"kubernetes.io/projected/fbe24664-3cbf-45fe-96e1-11200c84cd9e-kube-api-access-n4gh5\") pod \"kuadrant-operator-catalog-dtw6g\" (UID: \"fbe24664-3cbf-45fe-96e1-11200c84cd9e\") " pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" Jul 07 06:37:51.908393 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.908337 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" Jul 07 06:37:51.959748 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:51.959727 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtw6g"] Jul 07 06:37:52.038051 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:52.038025 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtw6g"] Jul 07 06:37:52.039993 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:37:52.039967 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe24664_3cbf_45fe_96e1_11200c84cd9e.slice/crio-572b61e1f4e21aba5ff37e17ce1eaf588c0185351a5b004c77d76c194b679899 WatchSource:0}: Error finding container 572b61e1f4e21aba5ff37e17ce1eaf588c0185351a5b004c77d76c194b679899: Status 404 returned error can't find the container with id 572b61e1f4e21aba5ff37e17ce1eaf588c0185351a5b004c77d76c194b679899 Jul 07 06:37:52.169158 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:52.169088 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bhskh"] Jul 07 06:37:52.173733 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:52.173717 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bhskh" Jul 07 06:37:52.184952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:52.184860 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bhskh"] Jul 07 06:37:52.305148 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:52.305108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" event={"ID":"fbe24664-3cbf-45fe-96e1-11200c84cd9e","Type":"ContainerStarted","Data":"572b61e1f4e21aba5ff37e17ce1eaf588c0185351a5b004c77d76c194b679899"} Jul 07 06:37:52.309497 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:52.309472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wx4w\" (UniqueName: \"kubernetes.io/projected/aa14b351-18c7-49d1-bdbc-5f9c23495210-kube-api-access-8wx4w\") pod \"kuadrant-operator-catalog-bhskh\" (UID: \"aa14b351-18c7-49d1-bdbc-5f9c23495210\") " pod="kuadrant-system/kuadrant-operator-catalog-bhskh" Jul 07 06:37:52.410663 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:52.410638 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wx4w\" (UniqueName: \"kubernetes.io/projected/aa14b351-18c7-49d1-bdbc-5f9c23495210-kube-api-access-8wx4w\") pod \"kuadrant-operator-catalog-bhskh\" (UID: \"aa14b351-18c7-49d1-bdbc-5f9c23495210\") " pod="kuadrant-system/kuadrant-operator-catalog-bhskh" Jul 07 06:37:52.425946 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:52.425875 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wx4w\" (UniqueName: \"kubernetes.io/projected/aa14b351-18c7-49d1-bdbc-5f9c23495210-kube-api-access-8wx4w\") pod \"kuadrant-operator-catalog-bhskh\" (UID: \"aa14b351-18c7-49d1-bdbc-5f9c23495210\") " pod="kuadrant-system/kuadrant-operator-catalog-bhskh" Jul 07 06:37:52.487199 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:52.487149 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bhskh" Jul 07 06:37:52.683697 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:52.683669 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bhskh"] Jul 07 06:37:52.746925 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:37:52.746893 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa14b351_18c7_49d1_bdbc_5f9c23495210.slice/crio-9c0c0354f71fb78943237aec09fea17a672d03ed49da12923e049c0add5c910a WatchSource:0}: Error finding container 9c0c0354f71fb78943237aec09fea17a672d03ed49da12923e049c0add5c910a: Status 404 returned error can't find the container with id 9c0c0354f71fb78943237aec09fea17a672d03ed49da12923e049c0add5c910a Jul 07 06:37:53.313182 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:53.313143 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bhskh" event={"ID":"aa14b351-18c7-49d1-bdbc-5f9c23495210","Type":"ContainerStarted","Data":"9c0c0354f71fb78943237aec09fea17a672d03ed49da12923e049c0add5c910a"} Jul 07 06:37:54.319725 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:54.319688 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" event={"ID":"fbe24664-3cbf-45fe-96e1-11200c84cd9e","Type":"ContainerStarted","Data":"c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342"} Jul 07 06:37:54.320240 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:54.319775 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" podUID="fbe24664-3cbf-45fe-96e1-11200c84cd9e" containerName="registry-server" containerID="cri-o://c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342" gracePeriod=2 Jul 07 06:37:54.321498 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:54.321471 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bhskh" event={"ID":"aa14b351-18c7-49d1-bdbc-5f9c23495210","Type":"ContainerStarted","Data":"7a5d715e32bbc78b37c62ca646715424f3e27ecae1ff6faecb3dbd84d0c08163"} Jul 07 06:37:54.335304 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:54.335263 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" podStartSLOduration=1.245030447 podStartE2EDuration="3.335247776s" totalImagesPullingTime="2.090217329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:37:54.334694877 +0000 UTC m=+387.336774191" watchObservedRunningTime="2026-07-07 06:37:54.335247776 +0000 UTC m=+387.337327088" Jul 07 06:37:54.350337 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:54.350296 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bhskh" podStartSLOduration=0.96397768 podStartE2EDuration="2.350284169s" totalImagesPullingTime="1.386306489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:37:54.34867249 +0000 UTC m=+387.350751802" watchObservedRunningTime="2026-07-07 06:37:54.350284169 +0000 UTC m=+387.352363480" Jul 07 06:37:54.567359 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:54.567334 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" Jul 07 06:37:54.632116 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:54.632014 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4gh5\" (UniqueName: \"kubernetes.io/projected/fbe24664-3cbf-45fe-96e1-11200c84cd9e-kube-api-access-n4gh5\") pod \"fbe24664-3cbf-45fe-96e1-11200c84cd9e\" (UID: \"fbe24664-3cbf-45fe-96e1-11200c84cd9e\") " Jul 07 06:37:54.634276 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:54.634246 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe24664-3cbf-45fe-96e1-11200c84cd9e-kube-api-access-n4gh5" (OuterVolumeSpecName: "kube-api-access-n4gh5") pod "fbe24664-3cbf-45fe-96e1-11200c84cd9e" (UID: "fbe24664-3cbf-45fe-96e1-11200c84cd9e"). InnerVolumeSpecName "kube-api-access-n4gh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:37:54.732825 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:54.732800 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4gh5\" (UniqueName: \"kubernetes.io/projected/fbe24664-3cbf-45fe-96e1-11200c84cd9e-kube-api-access-n4gh5\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:37:55.326781 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:55.326753 2575 generic.go:356] "Generic (PLEG): container finished" podID="fbe24664-3cbf-45fe-96e1-11200c84cd9e" containerID="c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342" exitCode=0 Jul 07 06:37:55.327186 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:55.326799 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" Jul 07 06:37:55.327186 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:55.326845 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" event={"ID":"fbe24664-3cbf-45fe-96e1-11200c84cd9e","Type":"ContainerDied","Data":"c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342"} Jul 07 06:37:55.327186 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:55.326897 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtw6g" event={"ID":"fbe24664-3cbf-45fe-96e1-11200c84cd9e","Type":"ContainerDied","Data":"572b61e1f4e21aba5ff37e17ce1eaf588c0185351a5b004c77d76c194b679899"} Jul 07 06:37:55.327186 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:55.326923 2575 scope.go:117] "RemoveContainer" containerID="c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342" Jul 07 06:37:55.336111 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:55.336095 2575 scope.go:117] "RemoveContainer" containerID="c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342" Jul 07 06:37:55.336348 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:37:55.336328 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342\": container with ID starting with c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342 not found: ID does not exist" containerID="c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342" Jul 07 06:37:55.336409 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:55.336361 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342"} err="failed to get container status \"c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342\": rpc error: code = NotFound desc = could not find container \"c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342\": container with ID starting with c0ad4440918e7f6c1986b0b730316fd98cd6a836a90abfb524f0669604015342 not found: ID does not exist" Jul 07 06:37:55.348724 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:55.348703 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtw6g"] Jul 07 06:37:55.353665 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:55.353643 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtw6g"] Jul 07 06:37:55.527258 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:37:55.527229 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbe24664-3cbf-45fe-96e1-11200c84cd9e" path="/var/lib/kubelet/pods/fbe24664-3cbf-45fe-96e1-11200c84cd9e/volumes" Jul 07 06:38:02.487499 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:02.487466 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-bhskh" Jul 07 06:38:02.487989 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:02.487522 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-bhskh" Jul 07 06:38:02.510399 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:02.510363 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-bhskh" Jul 07 06:38:03.385216 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:03.385187 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-bhskh" Jul 07 06:38:23.501392 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.501354 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66"] Jul 07 06:38:23.501850 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.501833 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe24664-3cbf-45fe-96e1-11200c84cd9e" containerName="registry-server" Jul 07 06:38:23.501899 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.501852 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe24664-3cbf-45fe-96e1-11200c84cd9e" containerName="registry-server" Jul 07 06:38:23.501949 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.501939 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe24664-3cbf-45fe-96e1-11200c84cd9e" containerName="registry-server" Jul 07 06:38:23.505154 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.505141 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66" Jul 07 06:38:23.508471 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.508449 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xd9rn\"" Jul 07 06:38:23.508593 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.508472 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 06:38:23.519919 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.519899 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66"] Jul 07 06:38:23.661802 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.661771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d288j\" (UniqueName: \"kubernetes.io/projected/aa70eb02-6cdd-4aed-96e9-6d9a179db64b-kube-api-access-d288j\") pod \"dns-operator-controller-manager-864dd78c4c-mlw66\" (UID: \"aa70eb02-6cdd-4aed-96e9-6d9a179db64b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66" Jul 07 06:38:23.762391 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.762313 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d288j\" (UniqueName: \"kubernetes.io/projected/aa70eb02-6cdd-4aed-96e9-6d9a179db64b-kube-api-access-d288j\") pod \"dns-operator-controller-manager-864dd78c4c-mlw66\" (UID: \"aa70eb02-6cdd-4aed-96e9-6d9a179db64b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66" Jul 07 06:38:23.777142 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.777110 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d288j\" (UniqueName: \"kubernetes.io/projected/aa70eb02-6cdd-4aed-96e9-6d9a179db64b-kube-api-access-d288j\") pod \"dns-operator-controller-manager-864dd78c4c-mlw66\" (UID: \"aa70eb02-6cdd-4aed-96e9-6d9a179db64b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66" Jul 07 06:38:23.814940 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.814912 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66" Jul 07 06:38:23.952126 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:23.952103 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66"] Jul 07 06:38:23.954689 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:38:23.954666 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa70eb02_6cdd_4aed_96e9_6d9a179db64b.slice/crio-677bd538f409b45abc57c796f2a5dff9daa88a9af496f42afc90bbf4ee113202 WatchSource:0}: Error finding container 677bd538f409b45abc57c796f2a5dff9daa88a9af496f42afc90bbf4ee113202: Status 404 returned error can't find the container with id 677bd538f409b45abc57c796f2a5dff9daa88a9af496f42afc90bbf4ee113202 Jul 07 06:38:24.454003 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:24.453966 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66" event={"ID":"aa70eb02-6cdd-4aed-96e9-6d9a179db64b","Type":"ContainerStarted","Data":"677bd538f409b45abc57c796f2a5dff9daa88a9af496f42afc90bbf4ee113202"} Jul 07 06:38:26.465014 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:26.464976 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66" event={"ID":"aa70eb02-6cdd-4aed-96e9-6d9a179db64b","Type":"ContainerStarted","Data":"1cecce6b1273c38339b7f9201d9843b99af68bc802cd79490de7612f18082433"} Jul 07 06:38:26.465391 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:26.465057 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66" Jul 07 06:38:26.483735 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:26.483696 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66" podStartSLOduration=1.436624682 podStartE2EDuration="3.483682013s" totalImagesPullingTime="2.047057331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:38:26.482630108 +0000 UTC m=+419.484709423" watchObservedRunningTime="2026-07-07 06:38:26.483682013 +0000 UTC m=+419.485761327" Jul 07 06:38:26.972916 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:26.972881 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds"] Jul 07 06:38:26.976336 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:26.976308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:26.979035 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:26.979013 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-54bxm\"" Jul 07 06:38:26.986418 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:26.986397 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxj57\" (UniqueName: \"kubernetes.io/projected/15d0ff67-c48d-4223-8b5b-6ff2a57da1de-kube-api-access-mxj57\") pod \"limitador-operator-controller-manager-859d7b78bd-fdlds\" (UID: \"15d0ff67-c48d-4223-8b5b-6ff2a57da1de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:26.986708 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:26.986690 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds"] Jul 07 06:38:27.087199 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:27.087163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxj57\" (UniqueName: \"kubernetes.io/projected/15d0ff67-c48d-4223-8b5b-6ff2a57da1de-kube-api-access-mxj57\") pod \"limitador-operator-controller-manager-859d7b78bd-fdlds\" (UID: \"15d0ff67-c48d-4223-8b5b-6ff2a57da1de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:27.098178 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:27.098148 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxj57\" (UniqueName: \"kubernetes.io/projected/15d0ff67-c48d-4223-8b5b-6ff2a57da1de-kube-api-access-mxj57\") pod \"limitador-operator-controller-manager-859d7b78bd-fdlds\" (UID: \"15d0ff67-c48d-4223-8b5b-6ff2a57da1de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:27.287673 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:27.287593 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:27.425926 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:27.425896 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds"] Jul 07 06:38:27.427358 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:38:27.427333 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d0ff67_c48d_4223_8b5b_6ff2a57da1de.slice/crio-12203fb0dffa79bdc19efc34b4fec72953f8d674a57f9e3e4f176979ee7d5d51 WatchSource:0}: Error finding container 12203fb0dffa79bdc19efc34b4fec72953f8d674a57f9e3e4f176979ee7d5d51: Status 404 returned error can't find the container with id 12203fb0dffa79bdc19efc34b4fec72953f8d674a57f9e3e4f176979ee7d5d51 Jul 07 06:38:27.470213 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:27.470177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" event={"ID":"15d0ff67-c48d-4223-8b5b-6ff2a57da1de","Type":"ContainerStarted","Data":"12203fb0dffa79bdc19efc34b4fec72953f8d674a57f9e3e4f176979ee7d5d51"} Jul 07 06:38:29.481662 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:29.481583 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" event={"ID":"15d0ff67-c48d-4223-8b5b-6ff2a57da1de","Type":"ContainerStarted","Data":"f8c3609fec27a3ae527a8706e9182509ed478ee1df0523bbfa9fe423ff1c83c6"} Jul 07 06:38:29.482025 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:29.481694 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:29.499146 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:29.499099 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" podStartSLOduration=1.733172215 podStartE2EDuration="3.499057716s" totalImagesPullingTime="1.765885501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:38:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:38:29.498844408 +0000 UTC m=+422.500923735" watchObservedRunningTime="2026-07-07 06:38:29.499057716 +0000 UTC m=+422.501137028" Jul 07 06:38:31.912166 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:31.912130 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf"] Jul 07 06:38:31.915589 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:31.915572 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:31.918582 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:31.918560 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8kr6t\"" Jul 07 06:38:31.922012 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:31.921987 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0e65295-3953-44f7-aa38-3af7c3f0da21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" (UID: \"f0e65295-3953-44f7-aa38-3af7c3f0da21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:31.922169 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:31.922035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hvzm\" (UniqueName: \"kubernetes.io/projected/f0e65295-3953-44f7-aa38-3af7c3f0da21-kube-api-access-9hvzm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" (UID: \"f0e65295-3953-44f7-aa38-3af7c3f0da21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:31.930573 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:31.930550 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf"] Jul 07 06:38:32.022764 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:32.022727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0e65295-3953-44f7-aa38-3af7c3f0da21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" (UID: \"f0e65295-3953-44f7-aa38-3af7c3f0da21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:32.022764 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:32.022766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hvzm\" (UniqueName: \"kubernetes.io/projected/f0e65295-3953-44f7-aa38-3af7c3f0da21-kube-api-access-9hvzm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" (UID: \"f0e65295-3953-44f7-aa38-3af7c3f0da21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:32.023239 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:32.023217 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0e65295-3953-44f7-aa38-3af7c3f0da21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" (UID: \"f0e65295-3953-44f7-aa38-3af7c3f0da21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:32.034333 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:32.034308 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hvzm\" (UniqueName: \"kubernetes.io/projected/f0e65295-3953-44f7-aa38-3af7c3f0da21-kube-api-access-9hvzm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" (UID: \"f0e65295-3953-44f7-aa38-3af7c3f0da21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:32.225911 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:32.225878 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:32.378517 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:32.378485 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf"] Jul 07 06:38:32.381929 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:38:32.381905 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e65295_3953_44f7_aa38_3af7c3f0da21.slice/crio-1028b87808a385bbceac9379d89d84ec1723807e55db29616adbd3534a74b85d WatchSource:0}: Error finding container 1028b87808a385bbceac9379d89d84ec1723807e55db29616adbd3534a74b85d: Status 404 returned error can't find the container with id 1028b87808a385bbceac9379d89d84ec1723807e55db29616adbd3534a74b85d Jul 07 06:38:32.496054 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:32.495986 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" event={"ID":"f0e65295-3953-44f7-aa38-3af7c3f0da21","Type":"ContainerStarted","Data":"1028b87808a385bbceac9379d89d84ec1723807e55db29616adbd3534a74b85d"} Jul 07 06:38:35.038053 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:35.037996 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk"] Jul 07 06:38:35.041861 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:35.041840 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk" Jul 07 06:38:35.045004 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:35.044848 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gvvx9\"" Jul 07 06:38:35.053188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:35.053165 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk"] Jul 07 06:38:35.147349 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:35.147320 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b78n\" (UniqueName: \"kubernetes.io/projected/94d8af56-5709-4160-abf4-164b3683a68a-kube-api-access-5b78n\") pod \"authorino-operator-75cc8d5cb7-4ldhk\" (UID: \"94d8af56-5709-4160-abf4-164b3683a68a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk" Jul 07 06:38:35.247720 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:35.247687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b78n\" (UniqueName: \"kubernetes.io/projected/94d8af56-5709-4160-abf4-164b3683a68a-kube-api-access-5b78n\") pod \"authorino-operator-75cc8d5cb7-4ldhk\" (UID: \"94d8af56-5709-4160-abf4-164b3683a68a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk" Jul 07 06:38:35.272679 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:35.272649 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b78n\" (UniqueName: \"kubernetes.io/projected/94d8af56-5709-4160-abf4-164b3683a68a-kube-api-access-5b78n\") pod \"authorino-operator-75cc8d5cb7-4ldhk\" (UID: \"94d8af56-5709-4160-abf4-164b3683a68a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk" Jul 07 06:38:35.355479 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:35.355423 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk" Jul 07 06:38:35.505556 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:35.505531 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk"] Jul 07 06:38:35.508170 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:38:35.508135 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d8af56_5709_4160_abf4_164b3683a68a.slice/crio-a6e666c6d76a5760fbc866804bfd29a255408e7606070d972591a75db0dc568e WatchSource:0}: Error finding container a6e666c6d76a5760fbc866804bfd29a255408e7606070d972591a75db0dc568e: Status 404 returned error can't find the container with id a6e666c6d76a5760fbc866804bfd29a255408e7606070d972591a75db0dc568e Jul 07 06:38:36.518227 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:36.518164 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk" event={"ID":"94d8af56-5709-4160-abf4-164b3683a68a","Type":"ContainerStarted","Data":"a6e666c6d76a5760fbc866804bfd29a255408e7606070d972591a75db0dc568e"} Jul 07 06:38:37.473161 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:37.473126 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mlw66" Jul 07 06:38:39.536548 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:39.536517 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk" event={"ID":"94d8af56-5709-4160-abf4-164b3683a68a","Type":"ContainerStarted","Data":"065711c96eea144dd440561124bf115c59195f9b32e3d49b60f50ab94d565182"} Jul 07 06:38:39.537017 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:39.536601 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk" Jul 07 06:38:39.538238 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:39.538211 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" event={"ID":"f0e65295-3953-44f7-aa38-3af7c3f0da21","Type":"ContainerStarted","Data":"5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553"} Jul 07 06:38:39.538379 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:39.538364 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:39.555624 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:39.555584 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk" podStartSLOduration=1.069258163 podStartE2EDuration="4.555571327s" totalImagesPullingTime="3.486313164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:38:39.554558753 +0000 UTC m=+432.556638066" watchObservedRunningTime="2026-07-07 06:38:39.555571327 +0000 UTC m=+432.557650639" Jul 07 06:38:39.575804 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:39.575764 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" podStartSLOduration=1.9515283559999999 podStartE2EDuration="8.575752076s" totalImagesPullingTime="6.62422372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:38:39.57514376 +0000 UTC m=+432.577223075" watchObservedRunningTime="2026-07-07 06:38:39.575752076 +0000 UTC m=+432.577831389" Jul 07 06:38:40.488568 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:40.488540 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:50.546116 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:50.546021 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4ldhk" Jul 07 06:38:50.546481 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:50.546239 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:51.846032 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:51.845998 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d"] Jul 07 06:38:51.849570 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:51.849551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:51.864839 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:51.864819 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d"] Jul 07 06:38:51.893532 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:51.893506 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdvf2\" (UniqueName: \"kubernetes.io/projected/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-kube-api-access-wdvf2\") pod \"kuadrant-operator-controller-manager-55467d9f7-9689d\" (UID: \"0177d88d-a2cc-4a92-86d7-3db5c5fd4281\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:51.893640 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:51.893559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9689d\" (UID: \"0177d88d-a2cc-4a92-86d7-3db5c5fd4281\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:51.993862 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:51.993832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9689d\" (UID: \"0177d88d-a2cc-4a92-86d7-3db5c5fd4281\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:51.993976 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:51.993918 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdvf2\" (UniqueName: \"kubernetes.io/projected/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-kube-api-access-wdvf2\") pod \"kuadrant-operator-controller-manager-55467d9f7-9689d\" (UID: \"0177d88d-a2cc-4a92-86d7-3db5c5fd4281\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:51.994223 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:51.994197 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9689d\" (UID: \"0177d88d-a2cc-4a92-86d7-3db5c5fd4281\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:52.006712 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.006690 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdvf2\" (UniqueName: \"kubernetes.io/projected/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-kube-api-access-wdvf2\") pod \"kuadrant-operator-controller-manager-55467d9f7-9689d\" (UID: \"0177d88d-a2cc-4a92-86d7-3db5c5fd4281\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:52.159622 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.159547 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:52.269467 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.269433 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d"] Jul 07 06:38:52.277342 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.277318 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d"] Jul 07 06:38:52.306525 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.306498 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5"] Jul 07 06:38:52.311639 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.311609 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:38:52.314126 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.314103 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf"] Jul 07 06:38:52.314306 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.314284 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" containerName="manager" containerID="cri-o://5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553" gracePeriod=2 Jul 07 06:38:52.329597 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.329570 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5"] Jul 07 06:38:52.336996 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.336971 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf"] Jul 07 06:38:52.354756 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.354727 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:52.359700 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.359680 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds"] Jul 07 06:38:52.359927 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.359900 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" containerName="manager" containerID="cri-o://f8c3609fec27a3ae527a8706e9182509ed478ee1df0523bbfa9fe423ff1c83c6" gracePeriod=2 Jul 07 06:38:52.370368 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.370340 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds"] Jul 07 06:38:52.372808 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.372771 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:52.390308 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.390277 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm"] Jul 07 06:38:52.390662 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.390650 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" containerName="manager" Jul 07 06:38:52.390704 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.390666 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" containerName="manager" Jul 07 06:38:52.390737 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.390713 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" containerName="manager" Jul 07 06:38:52.390737 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.390722 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" containerName="manager" Jul 07 06:38:52.390819 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.390808 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" containerName="manager" Jul 07 06:38:52.390851 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.390824 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" containerName="manager" Jul 07 06:38:52.394060 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.394044 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm" Jul 07 06:38:52.396797 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.396772 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlzmq\" (UniqueName: \"kubernetes.io/projected/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-kube-api-access-qlzmq\") pod \"kuadrant-operator-controller-manager-55467d9f7-vkwb5\" (UID: \"5a4e7780-f36b-48d6-b611-e2066e6f3d1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:38:52.396899 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.396854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vkwb5\" (UID: \"5a4e7780-f36b-48d6-b611-e2066e6f3d1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:38:52.396899 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.396871 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fdlds\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:52.399104 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.399063 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:52.407977 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.405895 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm"] Jul 07 06:38:52.423762 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.423730 2575 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 07 06:38:52.423762 ip-10-0-129-39 kubenswrapper[2575]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-9689d_kuadrant-system_0177d88d-a2cc-4a92-86d7-3db5c5fd4281_0(e111979bac9ad3a25371f1fc95d58329bdea50fd2aec2ac6ca2fdcf97a598245): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-9689d to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e111979bac9ad3a25371f1fc95d58329bdea50fd2aec2ac6ca2fdcf97a598245" Netns:"/var/run/netns/9dba29b4-c5fb-4220-a41b-2ccbf4b8d40f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-9689d;K8S_POD_INFRA_CONTAINER_ID=e111979bac9ad3a25371f1fc95d58329bdea50fd2aec2ac6ca2fdcf97a598245;K8S_POD_UID=0177d88d-a2cc-4a92-86d7-3db5c5fd4281" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d/0177d88d-a2cc-4a92-86d7-3db5c5fd4281]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-9689d in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-9689d in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-55467d9f7-9689d" not found Jul 07 06:38:52.423762 ip-10-0-129-39 kubenswrapper[2575]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 07 06:38:52.423762 ip-10-0-129-39 kubenswrapper[2575]: > Jul 07 06:38:52.423947 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.423798 2575 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 07 06:38:52.423947 ip-10-0-129-39 kubenswrapper[2575]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-9689d_kuadrant-system_0177d88d-a2cc-4a92-86d7-3db5c5fd4281_0(e111979bac9ad3a25371f1fc95d58329bdea50fd2aec2ac6ca2fdcf97a598245): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-9689d to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e111979bac9ad3a25371f1fc95d58329bdea50fd2aec2ac6ca2fdcf97a598245" Netns:"/var/run/netns/9dba29b4-c5fb-4220-a41b-2ccbf4b8d40f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-9689d;K8S_POD_INFRA_CONTAINER_ID=e111979bac9ad3a25371f1fc95d58329bdea50fd2aec2ac6ca2fdcf97a598245;K8S_POD_UID=0177d88d-a2cc-4a92-86d7-3db5c5fd4281" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d/0177d88d-a2cc-4a92-86d7-3db5c5fd4281]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-9689d in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-9689d in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-55467d9f7-9689d" not found Jul 07 06:38:52.423947 ip-10-0-129-39 kubenswrapper[2575]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 07 06:38:52.423947 ip-10-0-129-39 kubenswrapper[2575]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:52.498281 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.498182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vkwb5\" (UID: \"5a4e7780-f36b-48d6-b611-e2066e6f3d1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:38:52.498281 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.498271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77bc4\" (UniqueName: \"kubernetes.io/projected/7b36fac1-043f-4ec5-acfb-a5ef5edb8f21-kube-api-access-77bc4\") pod \"limitador-operator-controller-manager-859d7b78bd-7s4vm\" (UID: \"7b36fac1-043f-4ec5-acfb-a5ef5edb8f21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm" Jul 07 06:38:52.498467 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.498330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlzmq\" (UniqueName: \"kubernetes.io/projected/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-kube-api-access-qlzmq\") pod \"kuadrant-operator-controller-manager-55467d9f7-vkwb5\" (UID: \"5a4e7780-f36b-48d6-b611-e2066e6f3d1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:38:52.498637 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.498613 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vkwb5\" (UID: \"5a4e7780-f36b-48d6-b611-e2066e6f3d1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:38:52.507524 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.507495 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlzmq\" (UniqueName: \"kubernetes.io/projected/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-kube-api-access-qlzmq\") pod \"kuadrant-operator-controller-manager-55467d9f7-vkwb5\" (UID: \"5a4e7780-f36b-48d6-b611-e2066e6f3d1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:38:52.591342 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.591314 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:52.593877 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.593829 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fdlds\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:52.595820 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.595785 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:52.598838 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.598815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77bc4\" (UniqueName: \"kubernetes.io/projected/7b36fac1-043f-4ec5-acfb-a5ef5edb8f21-kube-api-access-77bc4\") pod \"limitador-operator-controller-manager-859d7b78bd-7s4vm\" (UID: \"7b36fac1-043f-4ec5-acfb-a5ef5edb8f21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm" Jul 07 06:38:52.598949 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.598881 2575 generic.go:356] "Generic (PLEG): container finished" podID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" containerID="f8c3609fec27a3ae527a8706e9182509ed478ee1df0523bbfa9fe423ff1c83c6" exitCode=0 Jul 07 06:38:52.600341 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.600318 2575 generic.go:356] "Generic (PLEG): container finished" podID="f0e65295-3953-44f7-aa38-3af7c3f0da21" containerID="5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553" exitCode=0 Jul 07 06:38:52.600431 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.600361 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:52.600431 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.600402 2575 scope.go:117] "RemoveContainer" containerID="5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553" Jul 07 06:38:52.600513 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.600482 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:52.602459 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.602440 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:52.602721 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.602696 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9689d\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="0177d88d-a2cc-4a92-86d7-3db5c5fd4281" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:52.604603 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.604577 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fdlds\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:52.606504 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.606482 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:52.606628 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.606611 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:52.608690 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.608669 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9689d\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="0177d88d-a2cc-4a92-86d7-3db5c5fd4281" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:52.608901 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.608885 2575 scope.go:117] "RemoveContainer" containerID="5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553" Jul 07 06:38:52.609169 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.609143 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553\": container with ID starting with 5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553 not found: ID does not exist" containerID="5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553" Jul 07 06:38:52.609351 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.609186 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553"} err="failed to get container status \"5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553\": rpc error: code = NotFound desc = could not find container \"5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553\": container with ID starting with 5d2b215235c691aeac131b80f311964f52ccf23714f3037df46b9d402e0eb553 not found: ID does not exist" Jul 07 06:38:52.610519 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.610496 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fdlds\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:52.611057 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.611042 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77bc4\" (UniqueName: \"kubernetes.io/projected/7b36fac1-043f-4ec5-acfb-a5ef5edb8f21-kube-api-access-77bc4\") pod \"limitador-operator-controller-manager-859d7b78bd-7s4vm\" (UID: \"7b36fac1-043f-4ec5-acfb-a5ef5edb8f21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm" Jul 07 06:38:52.612218 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.612200 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:52.614130 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.614055 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fdlds\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:52.615850 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.615830 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:52.617582 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.617563 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9689d\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="0177d88d-a2cc-4a92-86d7-3db5c5fd4281" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:52.624727 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.624713 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:38:52.699800 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.699768 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxj57\" (UniqueName: \"kubernetes.io/projected/15d0ff67-c48d-4223-8b5b-6ff2a57da1de-kube-api-access-mxj57\") pod \"15d0ff67-c48d-4223-8b5b-6ff2a57da1de\" (UID: \"15d0ff67-c48d-4223-8b5b-6ff2a57da1de\") " Jul 07 06:38:52.699947 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.699852 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0e65295-3953-44f7-aa38-3af7c3f0da21-extensions-socket-volume\") pod \"f0e65295-3953-44f7-aa38-3af7c3f0da21\" (UID: \"f0e65295-3953-44f7-aa38-3af7c3f0da21\") " Jul 07 06:38:52.700011 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.699948 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-extensions-socket-volume\") pod \"0177d88d-a2cc-4a92-86d7-3db5c5fd4281\" (UID: \"0177d88d-a2cc-4a92-86d7-3db5c5fd4281\") " Jul 07 06:38:52.700011 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.700002 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hvzm\" (UniqueName: \"kubernetes.io/projected/f0e65295-3953-44f7-aa38-3af7c3f0da21-kube-api-access-9hvzm\") pod \"f0e65295-3953-44f7-aa38-3af7c3f0da21\" (UID: \"f0e65295-3953-44f7-aa38-3af7c3f0da21\") " Jul 07 06:38:52.700128 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.700028 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdvf2\" (UniqueName: \"kubernetes.io/projected/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-kube-api-access-wdvf2\") pod \"0177d88d-a2cc-4a92-86d7-3db5c5fd4281\" (UID: \"0177d88d-a2cc-4a92-86d7-3db5c5fd4281\") " Jul 07 06:38:52.700282 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.700250 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0177d88d-a2cc-4a92-86d7-3db5c5fd4281" (UID: "0177d88d-a2cc-4a92-86d7-3db5c5fd4281"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 06:38:52.700389 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.700365 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-extensions-socket-volume\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:38:52.700501 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.700411 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0e65295-3953-44f7-aa38-3af7c3f0da21-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f0e65295-3953-44f7-aa38-3af7c3f0da21" (UID: "f0e65295-3953-44f7-aa38-3af7c3f0da21"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 06:38:52.702190 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.702161 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d0ff67-c48d-4223-8b5b-6ff2a57da1de-kube-api-access-mxj57" (OuterVolumeSpecName: "kube-api-access-mxj57") pod "15d0ff67-c48d-4223-8b5b-6ff2a57da1de" (UID: "15d0ff67-c48d-4223-8b5b-6ff2a57da1de"). InnerVolumeSpecName "kube-api-access-mxj57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:38:52.702267 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.702192 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e65295-3953-44f7-aa38-3af7c3f0da21-kube-api-access-9hvzm" (OuterVolumeSpecName: "kube-api-access-9hvzm") pod "f0e65295-3953-44f7-aa38-3af7c3f0da21" (UID: "f0e65295-3953-44f7-aa38-3af7c3f0da21"). InnerVolumeSpecName "kube-api-access-9hvzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:38:52.702410 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.702387 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-kube-api-access-wdvf2" (OuterVolumeSpecName: "kube-api-access-wdvf2") pod "0177d88d-a2cc-4a92-86d7-3db5c5fd4281" (UID: "0177d88d-a2cc-4a92-86d7-3db5c5fd4281"). InnerVolumeSpecName "kube-api-access-wdvf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:38:52.764594 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.764571 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5"] Jul 07 06:38:52.766346 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:38:52.766321 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4e7780_f36b_48d6_b611_e2066e6f3d1e.slice/crio-bc2ef3b3cfb81916a6ba5e608c934accaa1b91908928c64c52eece0e004572e3 WatchSource:0}: Error finding container bc2ef3b3cfb81916a6ba5e608c934accaa1b91908928c64c52eece0e004572e3: Status 404 returned error can't find the container with id bc2ef3b3cfb81916a6ba5e608c934accaa1b91908928c64c52eece0e004572e3 Jul 07 06:38:52.778623 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.778599 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm" Jul 07 06:38:52.801110 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.801090 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hvzm\" (UniqueName: \"kubernetes.io/projected/f0e65295-3953-44f7-aa38-3af7c3f0da21-kube-api-access-9hvzm\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:38:52.801209 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.801115 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdvf2\" (UniqueName: \"kubernetes.io/projected/0177d88d-a2cc-4a92-86d7-3db5c5fd4281-kube-api-access-wdvf2\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:38:52.801209 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.801128 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxj57\" (UniqueName: \"kubernetes.io/projected/15d0ff67-c48d-4223-8b5b-6ff2a57da1de-kube-api-access-mxj57\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:38:52.801209 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.801137 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0e65295-3953-44f7-aa38-3af7c3f0da21-extensions-socket-volume\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:38:52.912598 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.912563 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9689d\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="0177d88d-a2cc-4a92-86d7-3db5c5fd4281" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:52.915098 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.915054 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fdlds\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:52.918611 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:52.918587 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cd8pf\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cd8pf" Jul 07 06:38:52.925637 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:52.925619 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm"] Jul 07 06:38:52.927632 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:38:52.927613 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b36fac1_043f_4ec5_acfb_a5ef5edb8f21.slice/crio-838cdf8a679e92efa6896ce30ff6e1a84e7297c4955bb549e6d38cc8fac1317f WatchSource:0}: Error finding container 838cdf8a679e92efa6896ce30ff6e1a84e7297c4955bb549e6d38cc8fac1317f: Status 404 returned error can't find the container with id 838cdf8a679e92efa6896ce30ff6e1a84e7297c4955bb549e6d38cc8fac1317f Jul 07 06:38:53.528347 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.528318 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0177d88d-a2cc-4a92-86d7-3db5c5fd4281" path="/var/lib/kubelet/pods/0177d88d-a2cc-4a92-86d7-3db5c5fd4281/volumes" Jul 07 06:38:53.528551 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.528539 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d0ff67-c48d-4223-8b5b-6ff2a57da1de" path="/var/lib/kubelet/pods/15d0ff67-c48d-4223-8b5b-6ff2a57da1de/volumes" Jul 07 06:38:53.528867 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.528855 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0e65295-3953-44f7-aa38-3af7c3f0da21" path="/var/lib/kubelet/pods/f0e65295-3953-44f7-aa38-3af7c3f0da21/volumes" Jul 07 06:38:53.606952 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.606907 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" event={"ID":"5a4e7780-f36b-48d6-b611-e2066e6f3d1e","Type":"ContainerStarted","Data":"80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097"} Jul 07 06:38:53.607103 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.607061 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:38:53.607173 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.607107 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" event={"ID":"5a4e7780-f36b-48d6-b611-e2066e6f3d1e","Type":"ContainerStarted","Data":"bc2ef3b3cfb81916a6ba5e608c934accaa1b91908928c64c52eece0e004572e3"} Jul 07 06:38:53.608446 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.608423 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm" event={"ID":"7b36fac1-043f-4ec5-acfb-a5ef5edb8f21","Type":"ContainerStarted","Data":"d2c42dafddf1acada531a1ffa5901207b44760f4c703b705860021565ccc7fa6"} Jul 07 06:38:53.608532 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.608467 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm" event={"ID":"7b36fac1-043f-4ec5-acfb-a5ef5edb8f21","Type":"ContainerStarted","Data":"838cdf8a679e92efa6896ce30ff6e1a84e7297c4955bb549e6d38cc8fac1317f"} Jul 07 06:38:53.608532 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.608524 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm" Jul 07 06:38:53.609699 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.609684 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fdlds" Jul 07 06:38:53.609811 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.609720 2575 scope.go:117] "RemoveContainer" containerID="f8c3609fec27a3ae527a8706e9182509ed478ee1df0523bbfa9fe423ff1c83c6" Jul 07 06:38:53.610859 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.610778 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:53.635924 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:38:53.635896 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9689d\" is forbidden: User \"system:node:ip-10-0-129-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-39.ec2.internal' and this object" podUID="0177d88d-a2cc-4a92-86d7-3db5c5fd4281" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9689d" Jul 07 06:38:53.636097 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.636027 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" podStartSLOduration=1.6360108119999999 podStartE2EDuration="1.636010812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:38:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:38:53.633558079 +0000 UTC m=+446.635637403" watchObservedRunningTime="2026-07-07 06:38:53.636010812 +0000 UTC m=+446.638090126" Jul 07 06:38:53.660053 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:38:53.660009 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm" podStartSLOduration=1.65999663 podStartE2EDuration="1.65999663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:38:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:38:53.659917932 +0000 UTC m=+446.661997245" watchObservedRunningTime="2026-07-07 06:38:53.65999663 +0000 UTC m=+446.662075943" Jul 07 06:39:04.619898 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:04.619867 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7s4vm" Jul 07 06:39:04.620327 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:04.620260 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:39:04.914464 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:04.914390 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn"] Jul 07 06:39:04.921193 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:04.921177 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:39:04.933783 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:04.933762 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn"] Jul 07 06:39:04.999705 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:04.999678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7sqnn\" (UID: \"4d7e13c7-6ece-4c36-bd06-2fc5be00999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:39:04.999827 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:04.999745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcvvk\" (UniqueName: \"kubernetes.io/projected/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-kube-api-access-tcvvk\") pod \"kuadrant-operator-controller-manager-86878c769f-7sqnn\" (UID: \"4d7e13c7-6ece-4c36-bd06-2fc5be00999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:39:05.101150 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:05.101121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7sqnn\" (UID: \"4d7e13c7-6ece-4c36-bd06-2fc5be00999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:39:05.101275 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:05.101169 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcvvk\" (UniqueName: \"kubernetes.io/projected/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-kube-api-access-tcvvk\") pod \"kuadrant-operator-controller-manager-86878c769f-7sqnn\" (UID: \"4d7e13c7-6ece-4c36-bd06-2fc5be00999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:39:05.101458 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:05.101441 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7sqnn\" (UID: \"4d7e13c7-6ece-4c36-bd06-2fc5be00999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:39:05.114842 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:05.114812 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcvvk\" (UniqueName: \"kubernetes.io/projected/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-kube-api-access-tcvvk\") pod \"kuadrant-operator-controller-manager-86878c769f-7sqnn\" (UID: \"4d7e13c7-6ece-4c36-bd06-2fc5be00999c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:39:05.231136 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:05.231104 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:39:05.383240 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:05.383193 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn"] Jul 07 06:39:05.386407 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:39:05.386369 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7e13c7_6ece_4c36_bd06_2fc5be00999c.slice/crio-98c4c12fc615b43cdbbb29e7da0f3759c5b4ec25018a4340234f673db4dc13b0 WatchSource:0}: Error finding container 98c4c12fc615b43cdbbb29e7da0f3759c5b4ec25018a4340234f673db4dc13b0: Status 404 returned error can't find the container with id 98c4c12fc615b43cdbbb29e7da0f3759c5b4ec25018a4340234f673db4dc13b0 Jul 07 06:39:05.672762 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:05.672674 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" event={"ID":"4d7e13c7-6ece-4c36-bd06-2fc5be00999c","Type":"ContainerStarted","Data":"28221edf149e74b9c90d4268b5bdee854555a20f398cd7d9122a8c785d1aac18"} Jul 07 06:39:05.672762 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:05.672724 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" event={"ID":"4d7e13c7-6ece-4c36-bd06-2fc5be00999c","Type":"ContainerStarted","Data":"98c4c12fc615b43cdbbb29e7da0f3759c5b4ec25018a4340234f673db4dc13b0"} Jul 07 06:39:05.673181 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:05.672807 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:39:05.699922 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:05.699874 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" podStartSLOduration=1.699859806 podStartE2EDuration="1.699859806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:39:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:39:05.698534821 +0000 UTC m=+458.700614144" watchObservedRunningTime="2026-07-07 06:39:05.699859806 +0000 UTC m=+458.701939118" Jul 07 06:39:16.680191 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:16.680163 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:39:16.730427 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:16.730397 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5"] Jul 07 06:39:16.730687 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:16.730636 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" podUID="5a4e7780-f36b-48d6-b611-e2066e6f3d1e" containerName="manager" containerID="cri-o://80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097" gracePeriod=10 Jul 07 06:39:16.976944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:16.976922 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:39:17.097628 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.097600 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-extensions-socket-volume\") pod \"5a4e7780-f36b-48d6-b611-e2066e6f3d1e\" (UID: \"5a4e7780-f36b-48d6-b611-e2066e6f3d1e\") " Jul 07 06:39:17.097775 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.097644 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlzmq\" (UniqueName: \"kubernetes.io/projected/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-kube-api-access-qlzmq\") pod \"5a4e7780-f36b-48d6-b611-e2066e6f3d1e\" (UID: \"5a4e7780-f36b-48d6-b611-e2066e6f3d1e\") " Jul 07 06:39:17.097963 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.097943 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5a4e7780-f36b-48d6-b611-e2066e6f3d1e" (UID: "5a4e7780-f36b-48d6-b611-e2066e6f3d1e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 06:39:17.099885 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.099862 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-kube-api-access-qlzmq" (OuterVolumeSpecName: "kube-api-access-qlzmq") pod "5a4e7780-f36b-48d6-b611-e2066e6f3d1e" (UID: "5a4e7780-f36b-48d6-b611-e2066e6f3d1e"). InnerVolumeSpecName "kube-api-access-qlzmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:39:17.198710 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.198678 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-extensions-socket-volume\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:39:17.198710 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.198707 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlzmq\" (UniqueName: \"kubernetes.io/projected/5a4e7780-f36b-48d6-b611-e2066e6f3d1e-kube-api-access-qlzmq\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:39:17.739413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.739377 2575 generic.go:356] "Generic (PLEG): container finished" podID="5a4e7780-f36b-48d6-b611-e2066e6f3d1e" containerID="80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097" exitCode=0 Jul 07 06:39:17.739761 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.739435 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" Jul 07 06:39:17.739761 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.739465 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" event={"ID":"5a4e7780-f36b-48d6-b611-e2066e6f3d1e","Type":"ContainerDied","Data":"80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097"} Jul 07 06:39:17.739761 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.739543 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5" event={"ID":"5a4e7780-f36b-48d6-b611-e2066e6f3d1e","Type":"ContainerDied","Data":"bc2ef3b3cfb81916a6ba5e608c934accaa1b91908928c64c52eece0e004572e3"} Jul 07 06:39:17.739761 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.739570 2575 scope.go:117] "RemoveContainer" containerID="80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097" Jul 07 06:39:17.748109 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.748091 2575 scope.go:117] "RemoveContainer" containerID="80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097" Jul 07 06:39:17.748400 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:39:17.748379 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097\": container with ID starting with 80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097 not found: ID does not exist" containerID="80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097" Jul 07 06:39:17.748470 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.748411 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097"} err="failed to get container status \"80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097\": rpc error: code = NotFound desc = could not find container \"80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097\": container with ID starting with 80bab15eb0b859fccab01fad31abb1ce5a5f05a59631a7a3ce90aff3da04a097 not found: ID does not exist" Jul 07 06:39:17.767426 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.767404 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5"] Jul 07 06:39:17.771446 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:17.771426 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vkwb5"] Jul 07 06:39:19.527755 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:19.527716 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a4e7780-f36b-48d6-b611-e2066e6f3d1e" path="/var/lib/kubelet/pods/5a4e7780-f36b-48d6-b611-e2066e6f3d1e/volumes" Jul 07 06:39:35.938571 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:35.938534 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:39:35.939436 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:35.939414 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4e7780-f36b-48d6-b611-e2066e6f3d1e" containerName="manager" Jul 07 06:39:35.939436 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:35.939437 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4e7780-f36b-48d6-b611-e2066e6f3d1e" containerName="manager" Jul 07 06:39:35.939611 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:35.939520 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4e7780-f36b-48d6-b611-e2066e6f3d1e" containerName="manager" Jul 07 06:39:35.944505 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:35.944486 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" Jul 07 06:39:35.947553 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:35.947534 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jxfbm\"" Jul 07 06:39:35.948031 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:35.948007 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 06:39:35.949932 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:35.949910 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:39:35.978495 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:35.978472 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:39:36.042608 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.042585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0bdb275a-0a4e-4d15-bdba-26bd36e51e9d-config-file\") pod \"limitador-limitador-54d6d988d5-k2cm4\" (UID: \"0bdb275a-0a4e-4d15-bdba-26bd36e51e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" Jul 07 06:39:36.042726 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.042631 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gv6r\" (UniqueName: \"kubernetes.io/projected/0bdb275a-0a4e-4d15-bdba-26bd36e51e9d-kube-api-access-5gv6r\") pod \"limitador-limitador-54d6d988d5-k2cm4\" (UID: \"0bdb275a-0a4e-4d15-bdba-26bd36e51e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" Jul 07 06:39:36.143857 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.143836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0bdb275a-0a4e-4d15-bdba-26bd36e51e9d-config-file\") pod \"limitador-limitador-54d6d988d5-k2cm4\" (UID: \"0bdb275a-0a4e-4d15-bdba-26bd36e51e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" Jul 07 06:39:36.143983 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.143888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gv6r\" (UniqueName: \"kubernetes.io/projected/0bdb275a-0a4e-4d15-bdba-26bd36e51e9d-kube-api-access-5gv6r\") pod \"limitador-limitador-54d6d988d5-k2cm4\" (UID: \"0bdb275a-0a4e-4d15-bdba-26bd36e51e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" Jul 07 06:39:36.144471 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.144453 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0bdb275a-0a4e-4d15-bdba-26bd36e51e9d-config-file\") pod \"limitador-limitador-54d6d988d5-k2cm4\" (UID: \"0bdb275a-0a4e-4d15-bdba-26bd36e51e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" Jul 07 06:39:36.152121 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.152098 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gv6r\" (UniqueName: \"kubernetes.io/projected/0bdb275a-0a4e-4d15-bdba-26bd36e51e9d-kube-api-access-5gv6r\") pod \"limitador-limitador-54d6d988d5-k2cm4\" (UID: \"0bdb275a-0a4e-4d15-bdba-26bd36e51e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" Jul 07 06:39:36.257018 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.256952 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" Jul 07 06:39:36.391619 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.391574 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:39:36.394139 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:39:36.394108 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bdb275a_0a4e_4d15_bdba_26bd36e51e9d.slice/crio-d06adfc5dcfa65f52494908e36b37a7d5ef650c7202330fdea15730edad47f83 WatchSource:0}: Error finding container d06adfc5dcfa65f52494908e36b37a7d5ef650c7202330fdea15730edad47f83: Status 404 returned error can't find the container with id d06adfc5dcfa65f52494908e36b37a7d5ef650c7202330fdea15730edad47f83 Jul 07 06:39:36.533542 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.533465 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4hgt"] Jul 07 06:39:36.538131 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.538111 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g4hgt" Jul 07 06:39:36.540693 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.540670 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-k296v\"" Jul 07 06:39:36.544678 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.544661 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4hgt"] Jul 07 06:39:36.546645 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.546619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqcjv\" (UniqueName: \"kubernetes.io/projected/df2281aa-06b4-4d09-bcc7-dad498e506cb-kube-api-access-mqcjv\") pod \"authorino-75d556bd77-g4hgt\" (UID: \"df2281aa-06b4-4d09-bcc7-dad498e506cb\") " pod="kuadrant-system/authorino-75d556bd77-g4hgt" Jul 07 06:39:36.647242 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.647216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqcjv\" (UniqueName: \"kubernetes.io/projected/df2281aa-06b4-4d09-bcc7-dad498e506cb-kube-api-access-mqcjv\") pod \"authorino-75d556bd77-g4hgt\" (UID: \"df2281aa-06b4-4d09-bcc7-dad498e506cb\") " pod="kuadrant-system/authorino-75d556bd77-g4hgt" Jul 07 06:39:36.658200 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.658175 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqcjv\" (UniqueName: \"kubernetes.io/projected/df2281aa-06b4-4d09-bcc7-dad498e506cb-kube-api-access-mqcjv\") pod \"authorino-75d556bd77-g4hgt\" (UID: \"df2281aa-06b4-4d09-bcc7-dad498e506cb\") " pod="kuadrant-system/authorino-75d556bd77-g4hgt" Jul 07 06:39:36.830745 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.830668 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" event={"ID":"0bdb275a-0a4e-4d15-bdba-26bd36e51e9d","Type":"ContainerStarted","Data":"d06adfc5dcfa65f52494908e36b37a7d5ef650c7202330fdea15730edad47f83"} Jul 07 06:39:36.848994 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.848970 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g4hgt" Jul 07 06:39:36.983534 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:36.983498 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4hgt"] Jul 07 06:39:36.986722 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:39:36.986693 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf2281aa_06b4_4d09_bcc7_dad498e506cb.slice/crio-190bc6c0eb7925b9a871751a583c04095d53a1f554f4c1555a9016b28d4e5189 WatchSource:0}: Error finding container 190bc6c0eb7925b9a871751a583c04095d53a1f554f4c1555a9016b28d4e5189: Status 404 returned error can't find the container with id 190bc6c0eb7925b9a871751a583c04095d53a1f554f4c1555a9016b28d4e5189 Jul 07 06:39:37.840766 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:37.840691 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g4hgt" event={"ID":"df2281aa-06b4-4d09-bcc7-dad498e506cb","Type":"ContainerStarted","Data":"190bc6c0eb7925b9a871751a583c04095d53a1f554f4c1555a9016b28d4e5189"} Jul 07 06:39:41.866496 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:41.866459 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g4hgt" event={"ID":"df2281aa-06b4-4d09-bcc7-dad498e506cb","Type":"ContainerStarted","Data":"991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644"} Jul 07 06:39:41.867944 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:41.867925 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" event={"ID":"0bdb275a-0a4e-4d15-bdba-26bd36e51e9d","Type":"ContainerStarted","Data":"5b6413475357d427c8a7c91c46afd522980f632bf366e495caaeec1a94e00b71"} Jul 07 06:39:41.868022 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:41.867974 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" Jul 07 06:39:41.883271 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:41.883223 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-g4hgt" podStartSLOduration=1.9884893049999999 podStartE2EDuration="5.883207585s" totalImagesPullingTime="3.89471828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:39:41.882110659 +0000 UTC m=+494.884189971" watchObservedRunningTime="2026-07-07 06:39:41.883207585 +0000 UTC m=+494.885286897" Jul 07 06:39:41.903127 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:41.903050 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" podStartSLOduration=2.417577075 podStartE2EDuration="6.90303475s" totalImagesPullingTime="4.485457675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:39:41.901784296 +0000 UTC m=+494.903863609" watchObservedRunningTime="2026-07-07 06:39:41.90303475 +0000 UTC m=+494.905114122" Jul 07 06:39:52.873678 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:39:52.873648 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-k2cm4" Jul 07 06:40:08.518903 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:08.518858 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4hgt"] Jul 07 06:40:08.519380 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:08.519158 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-g4hgt" podUID="df2281aa-06b4-4d09-bcc7-dad498e506cb" containerName="authorino" containerID="cri-o://991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644" gracePeriod=30 Jul 07 06:40:08.785257 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:08.785165 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g4hgt" Jul 07 06:40:08.916086 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:08.916054 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqcjv\" (UniqueName: \"kubernetes.io/projected/df2281aa-06b4-4d09-bcc7-dad498e506cb-kube-api-access-mqcjv\") pod \"df2281aa-06b4-4d09-bcc7-dad498e506cb\" (UID: \"df2281aa-06b4-4d09-bcc7-dad498e506cb\") " Jul 07 06:40:08.918288 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:08.918257 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df2281aa-06b4-4d09-bcc7-dad498e506cb-kube-api-access-mqcjv" (OuterVolumeSpecName: "kube-api-access-mqcjv") pod "df2281aa-06b4-4d09-bcc7-dad498e506cb" (UID: "df2281aa-06b4-4d09-bcc7-dad498e506cb"). InnerVolumeSpecName "kube-api-access-mqcjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:40:09.000229 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.000189 2575 generic.go:356] "Generic (PLEG): container finished" podID="df2281aa-06b4-4d09-bcc7-dad498e506cb" containerID="991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644" exitCode=0 Jul 07 06:40:09.000229 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.000229 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g4hgt" Jul 07 06:40:09.000439 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.000280 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g4hgt" event={"ID":"df2281aa-06b4-4d09-bcc7-dad498e506cb","Type":"ContainerDied","Data":"991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644"} Jul 07 06:40:09.000439 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.000321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g4hgt" event={"ID":"df2281aa-06b4-4d09-bcc7-dad498e506cb","Type":"ContainerDied","Data":"190bc6c0eb7925b9a871751a583c04095d53a1f554f4c1555a9016b28d4e5189"} Jul 07 06:40:09.000439 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.000339 2575 scope.go:117] "RemoveContainer" containerID="991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644" Jul 07 06:40:09.009777 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.009756 2575 scope.go:117] "RemoveContainer" containerID="991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644" Jul 07 06:40:09.010021 ip-10-0-129-39 kubenswrapper[2575]: E0707 06:40:09.010006 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644\": container with ID starting with 991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644 not found: ID does not exist" containerID="991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644" Jul 07 06:40:09.010115 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.010030 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644"} err="failed to get container status \"991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644\": rpc error: code = NotFound desc = could not find container \"991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644\": container with ID starting with 991031c37606583d8b4b077aa5a07785eb101b15bf8eefaacc49d43544166644 not found: ID does not exist" Jul 07 06:40:09.017143 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.017118 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqcjv\" (UniqueName: \"kubernetes.io/projected/df2281aa-06b4-4d09-bcc7-dad498e506cb-kube-api-access-mqcjv\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:40:09.021566 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.021543 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4hgt"] Jul 07 06:40:09.023279 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.023260 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4hgt"] Jul 07 06:40:09.527085 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:09.527050 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df2281aa-06b4-4d09-bcc7-dad498e506cb" path="/var/lib/kubelet/pods/df2281aa-06b4-4d09-bcc7-dad498e506cb/volumes" Jul 07 06:40:49.279739 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:40:49.279696 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:41:03.040720 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:03.040687 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:41:12.665683 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.665653 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s"] Jul 07 06:41:12.666276 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.666243 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df2281aa-06b4-4d09-bcc7-dad498e506cb" containerName="authorino" Jul 07 06:41:12.666276 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.666276 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="df2281aa-06b4-4d09-bcc7-dad498e506cb" containerName="authorino" Jul 07 06:41:12.666475 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.666370 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="df2281aa-06b4-4d09-bcc7-dad498e506cb" containerName="authorino" Jul 07 06:41:12.669678 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.669659 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.672509 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.672490 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 06:41:12.673898 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.673873 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7scrk\"" Jul 07 06:41:12.673991 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.673874 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 06:41:12.673991 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.673874 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 06:41:12.679474 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.679454 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s"] Jul 07 06:41:12.831227 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.831194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw5j2\" (UniqueName: \"kubernetes.io/projected/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-kube-api-access-xw5j2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.831379 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.831248 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.831379 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.831328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.831379 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.831369 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.831517 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.831397 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.831517 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.831415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.932468 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.932441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.932605 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.932483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.932605 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.932530 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.932605 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.932562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.932605 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.932602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw5j2\" (UniqueName: \"kubernetes.io/projected/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-kube-api-access-xw5j2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.932814 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.932637 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.932957 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.932930 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.933098 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.932956 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.933098 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.933000 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.935346 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.935330 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.935697 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.935676 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.940848 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.940829 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw5j2\" (UniqueName: \"kubernetes.io/projected/026fbee8-8bb7-4a78-8e7d-1aa0664bf412-kube-api-access-xw5j2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xvw4s\" (UID: \"026fbee8-8bb7-4a78-8e7d-1aa0664bf412\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:12.980845 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:12.980824 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:13.118934 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:13.118906 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s"] Jul 07 06:41:13.121056 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:41:13.121029 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026fbee8_8bb7_4a78_8e7d_1aa0664bf412.slice/crio-612f3808a460a41bd5d2b3f01798381d596df69ee3edd11bbaad1d45343cba11 WatchSource:0}: Error finding container 612f3808a460a41bd5d2b3f01798381d596df69ee3edd11bbaad1d45343cba11: Status 404 returned error can't find the container with id 612f3808a460a41bd5d2b3f01798381d596df69ee3edd11bbaad1d45343cba11 Jul 07 06:41:13.309253 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:13.309174 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" event={"ID":"026fbee8-8bb7-4a78-8e7d-1aa0664bf412","Type":"ContainerStarted","Data":"612f3808a460a41bd5d2b3f01798381d596df69ee3edd11bbaad1d45343cba11"} Jul 07 06:41:13.446413 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:13.446379 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:41:15.320677 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:15.320643 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" event={"ID":"026fbee8-8bb7-4a78-8e7d-1aa0664bf412","Type":"ContainerStarted","Data":"298948ce32baa31ba8291541b03b76ff8a164c82a41257af0a9c5b9ded16cf12"} Jul 07 06:41:15.339115 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:15.339045 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" podStartSLOduration=2.192706997 podStartE2EDuration="3.33902905s" totalImagesPullingTime="1.146322053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:41:15.337562885 +0000 UTC m=+588.339642199" watchObservedRunningTime="2026-07-07 06:41:15.33902905 +0000 UTC m=+588.341108363" Jul 07 06:41:22.981835 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:22.981797 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:22.982326 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:22.981859 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:22.993914 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:22.993886 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:23.372612 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:23.372527 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xvw4s" Jul 07 06:41:27.461188 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:27.461159 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:41:27.468337 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:27.468314 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:41:31.437360 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:31.437329 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:41:33.801415 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:33.801381 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh"] Jul 07 06:41:33.805092 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:33.805055 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:33.807959 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:33.807938 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 07 06:41:33.817569 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:33.817539 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh"] Jul 07 06:41:33.901466 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:33.901441 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:33.901575 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:33.901487 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:33.901575 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:33.901503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:33.901575 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:33.901528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:33.901575 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:33.901561 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:33.901750 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:33.901673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkhjf\" (UniqueName: \"kubernetes.io/projected/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-kube-api-access-kkhjf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.002849 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.002824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.002974 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.002868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkhjf\" (UniqueName: \"kubernetes.io/projected/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-kube-api-access-kkhjf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.002974 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.002904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.002974 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.002932 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.002974 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.002947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.002974 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.002962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.003294 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.003271 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.003353 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.003298 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.003411 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.003393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.005312 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.005292 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.005590 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.005575 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.010967 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.010947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkhjf\" (UniqueName: \"kubernetes.io/projected/52d20cc6-815e-4e22-b0d1-bce2c4b99a05-kube-api-access-kkhjf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh\" (UID: \"52d20cc6-815e-4e22-b0d1-bce2c4b99a05\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.116171 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.116113 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:34.255991 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.255968 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh"] Jul 07 06:41:34.257940 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:41:34.257914 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d20cc6_815e_4e22_b0d1_bce2c4b99a05.slice/crio-435598c962e780933985458fc785425bf466c84339b39e68dc4854382d5fd8f9 WatchSource:0}: Error finding container 435598c962e780933985458fc785425bf466c84339b39e68dc4854382d5fd8f9: Status 404 returned error can't find the container with id 435598c962e780933985458fc785425bf466c84339b39e68dc4854382d5fd8f9 Jul 07 06:41:34.259337 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.259321 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 06:41:34.416318 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:34.416251 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" event={"ID":"52d20cc6-815e-4e22-b0d1-bce2c4b99a05","Type":"ContainerStarted","Data":"435598c962e780933985458fc785425bf466c84339b39e68dc4854382d5fd8f9"} Jul 07 06:41:35.421813 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:35.421783 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" event={"ID":"52d20cc6-815e-4e22-b0d1-bce2c4b99a05","Type":"ContainerStarted","Data":"9b0229614f1262dde8607103bebab2e5480bfad065dda1de33fc4e6342b5d905"} Jul 07 06:41:35.439200 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:35.439139 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" podStartSLOduration=2.24095932 podStartE2EDuration="2.439122962s" totalImagesPullingTime="198.163642ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:41:35.438273806 +0000 UTC m=+608.440353113" watchObservedRunningTime="2026-07-07 06:41:35.439122962 +0000 UTC m=+608.441202276" Jul 07 06:41:35.562343 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:35.562307 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:41:40.539594 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:40.539560 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:41:44.116942 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:44.116908 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:44.117439 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:44.116978 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:44.128852 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:44.128832 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:44.476797 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:44.476769 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh" Jul 07 06:41:51.737595 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:41:51.737518 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:43:09.859623 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:09.859588 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74b96f99f7-2km6g"] Jul 07 06:43:09.863293 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:09.863273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b96f99f7-2km6g" Jul 07 06:43:09.867162 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:09.867142 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 06:43:09.867162 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:09.867158 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-k296v\"" Jul 07 06:43:09.871792 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:09.871766 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74b96f99f7-2km6g"] Jul 07 06:43:09.981172 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:09.981142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg5gv\" (UniqueName: \"kubernetes.io/projected/ea6accee-090b-4643-b5a4-2202aff9c209-kube-api-access-kg5gv\") pod \"authorino-74b96f99f7-2km6g\" (UID: \"ea6accee-090b-4643-b5a4-2202aff9c209\") " pod="kuadrant-system/authorino-74b96f99f7-2km6g" Jul 07 06:43:09.981355 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:09.981221 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea6accee-090b-4643-b5a4-2202aff9c209-tls-cert\") pod \"authorino-74b96f99f7-2km6g\" (UID: \"ea6accee-090b-4643-b5a4-2202aff9c209\") " pod="kuadrant-system/authorino-74b96f99f7-2km6g" Jul 07 06:43:10.082530 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:10.082495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg5gv\" (UniqueName: \"kubernetes.io/projected/ea6accee-090b-4643-b5a4-2202aff9c209-kube-api-access-kg5gv\") pod \"authorino-74b96f99f7-2km6g\" (UID: \"ea6accee-090b-4643-b5a4-2202aff9c209\") " pod="kuadrant-system/authorino-74b96f99f7-2km6g" Jul 07 06:43:10.082699 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:10.082566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea6accee-090b-4643-b5a4-2202aff9c209-tls-cert\") pod \"authorino-74b96f99f7-2km6g\" (UID: \"ea6accee-090b-4643-b5a4-2202aff9c209\") " pod="kuadrant-system/authorino-74b96f99f7-2km6g" Jul 07 06:43:10.085300 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:10.085270 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea6accee-090b-4643-b5a4-2202aff9c209-tls-cert\") pod \"authorino-74b96f99f7-2km6g\" (UID: \"ea6accee-090b-4643-b5a4-2202aff9c209\") " pod="kuadrant-system/authorino-74b96f99f7-2km6g" Jul 07 06:43:10.093846 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:10.093821 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg5gv\" (UniqueName: \"kubernetes.io/projected/ea6accee-090b-4643-b5a4-2202aff9c209-kube-api-access-kg5gv\") pod \"authorino-74b96f99f7-2km6g\" (UID: \"ea6accee-090b-4643-b5a4-2202aff9c209\") " pod="kuadrant-system/authorino-74b96f99f7-2km6g" Jul 07 06:43:10.172992 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:10.172923 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b96f99f7-2km6g" Jul 07 06:43:10.316981 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:10.316955 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74b96f99f7-2km6g"] Jul 07 06:43:10.318965 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:43:10.318935 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea6accee_090b_4643_b5a4_2202aff9c209.slice/crio-85cf7ba45277e89cea1c3ff47ab9009d4f6ff03320ae449afebc0f9e01f4d9b5 WatchSource:0}: Error finding container 85cf7ba45277e89cea1c3ff47ab9009d4f6ff03320ae449afebc0f9e01f4d9b5: Status 404 returned error can't find the container with id 85cf7ba45277e89cea1c3ff47ab9009d4f6ff03320ae449afebc0f9e01f4d9b5 Jul 07 06:43:10.883705 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:10.883668 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b96f99f7-2km6g" event={"ID":"ea6accee-090b-4643-b5a4-2202aff9c209","Type":"ContainerStarted","Data":"f2e045e188e08f6d072abef246843d19d9729f8421160a07d39d50fcb299e034"} Jul 07 06:43:10.884141 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:10.883716 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b96f99f7-2km6g" event={"ID":"ea6accee-090b-4643-b5a4-2202aff9c209","Type":"ContainerStarted","Data":"85cf7ba45277e89cea1c3ff47ab9009d4f6ff03320ae449afebc0f9e01f4d9b5"} Jul 07 06:43:10.903692 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:10.903635 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74b96f99f7-2km6g" podStartSLOduration=1.45948631 podStartE2EDuration="1.903613249s" totalImagesPullingTime="444.126939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:43:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:43:10.901339699 +0000 UTC m=+703.903419013" watchObservedRunningTime="2026-07-07 06:43:10.903613249 +0000 UTC m=+703.905692564" Jul 07 06:43:39.844257 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:39.844179 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:43:49.141773 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:43:49.141740 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:44:00.437534 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:44:00.437506 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:44:09.050756 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:44:09.050724 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:44:19.344205 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:44:19.344172 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:44:46.348042 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:44:46.348002 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:44:57.640472 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:44:57.640400 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:45:31.353511 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:45:31.353467 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:45:41.440913 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:45:41.440878 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:45:49.937514 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:45:49.937481 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:45:59.158427 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:45:59.158392 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:46:09.646524 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:46:09.646489 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:46:18.454135 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:46:18.454015 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:46:27.491962 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:46:27.491932 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:46:27.496282 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:46:27.496256 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:46:30.341592 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:46:30.341561 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:46:37.347834 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:46:37.347800 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:46:44.936666 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:46:44.936633 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:46:53.449325 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:46:53.449291 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:47:06.437629 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:47:06.437592 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:47:15.645617 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:47:15.645580 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:47:39.343935 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:47:39.343902 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:47:49.650018 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:47:49.649934 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:48:04.946656 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:48:04.946616 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:48:16.248287 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:48:16.248255 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:48:25.984681 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:48:25.984645 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:48:34.958392 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:48:34.958356 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:48:43.947942 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:48:43.947908 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:49:11.994650 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:11.994614 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn"] Jul 07 06:49:11.995109 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:11.994847 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" podUID="4d7e13c7-6ece-4c36-bd06-2fc5be00999c" containerName="manager" containerID="cri-o://28221edf149e74b9c90d4268b5bdee854555a20f398cd7d9122a8c785d1aac18" gracePeriod=10 Jul 07 06:49:14.713146 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:14.713115 2575 generic.go:356] "Generic (PLEG): container finished" podID="4d7e13c7-6ece-4c36-bd06-2fc5be00999c" containerID="28221edf149e74b9c90d4268b5bdee854555a20f398cd7d9122a8c785d1aac18" exitCode=0 Jul 07 06:49:14.713481 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:14.713188 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" event={"ID":"4d7e13c7-6ece-4c36-bd06-2fc5be00999c","Type":"ContainerDied","Data":"28221edf149e74b9c90d4268b5bdee854555a20f398cd7d9122a8c785d1aac18"} Jul 07 06:49:14.752399 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:14.752372 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:49:14.939796 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:14.939771 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-extensions-socket-volume\") pod \"4d7e13c7-6ece-4c36-bd06-2fc5be00999c\" (UID: \"4d7e13c7-6ece-4c36-bd06-2fc5be00999c\") " Jul 07 06:49:14.940047 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:14.939806 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcvvk\" (UniqueName: \"kubernetes.io/projected/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-kube-api-access-tcvvk\") pod \"4d7e13c7-6ece-4c36-bd06-2fc5be00999c\" (UID: \"4d7e13c7-6ece-4c36-bd06-2fc5be00999c\") " Jul 07 06:49:14.940157 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:14.940120 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4d7e13c7-6ece-4c36-bd06-2fc5be00999c" (UID: "4d7e13c7-6ece-4c36-bd06-2fc5be00999c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 06:49:14.942015 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:14.941992 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-kube-api-access-tcvvk" (OuterVolumeSpecName: "kube-api-access-tcvvk") pod "4d7e13c7-6ece-4c36-bd06-2fc5be00999c" (UID: "4d7e13c7-6ece-4c36-bd06-2fc5be00999c"). InnerVolumeSpecName "kube-api-access-tcvvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 06:49:15.041261 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:15.041226 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-extensions-socket-volume\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:49:15.041261 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:15.041259 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcvvk\" (UniqueName: \"kubernetes.io/projected/4d7e13c7-6ece-4c36-bd06-2fc5be00999c-kube-api-access-tcvvk\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Jul 07 06:49:15.719198 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:15.719168 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" Jul 07 06:49:15.719603 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:15.719201 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn" event={"ID":"4d7e13c7-6ece-4c36-bd06-2fc5be00999c","Type":"ContainerDied","Data":"98c4c12fc615b43cdbbb29e7da0f3759c5b4ec25018a4340234f673db4dc13b0"} Jul 07 06:49:15.719603 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:15.719264 2575 scope.go:117] "RemoveContainer" containerID="28221edf149e74b9c90d4268b5bdee854555a20f398cd7d9122a8c785d1aac18" Jul 07 06:49:15.740328 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:15.740307 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn"] Jul 07 06:49:15.746847 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:15.746824 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sqnn"] Jul 07 06:49:17.528084 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:49:17.528037 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d7e13c7-6ece-4c36-bd06-2fc5be00999c" path="/var/lib/kubelet/pods/4d7e13c7-6ece-4c36-bd06-2fc5be00999c/volumes" Jul 07 06:50:13.134721 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.134691 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7"] Jul 07 06:50:13.135339 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.135276 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7e13c7-6ece-4c36-bd06-2fc5be00999c" containerName="manager" Jul 07 06:50:13.135339 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.135297 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7e13c7-6ece-4c36-bd06-2fc5be00999c" containerName="manager" Jul 07 06:50:13.135456 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.135401 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d7e13c7-6ece-4c36-bd06-2fc5be00999c" containerName="manager" Jul 07 06:50:13.138368 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.138348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" Jul 07 06:50:13.141381 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.141365 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8kr6t\"" Jul 07 06:50:13.151637 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.151619 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7"] Jul 07 06:50:13.308883 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.308853 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0ce1ea0-df8c-4cb2-9468-5a4ac004f318-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sdbc7\" (UID: \"d0ce1ea0-df8c-4cb2-9468-5a4ac004f318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" Jul 07 06:50:13.309050 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.308902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gkqz\" (UniqueName: \"kubernetes.io/projected/d0ce1ea0-df8c-4cb2-9468-5a4ac004f318-kube-api-access-2gkqz\") pod \"kuadrant-operator-controller-manager-86878c769f-sdbc7\" (UID: \"d0ce1ea0-df8c-4cb2-9468-5a4ac004f318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" Jul 07 06:50:13.409458 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.409376 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0ce1ea0-df8c-4cb2-9468-5a4ac004f318-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sdbc7\" (UID: \"d0ce1ea0-df8c-4cb2-9468-5a4ac004f318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" Jul 07 06:50:13.409458 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.409425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gkqz\" (UniqueName: \"kubernetes.io/projected/d0ce1ea0-df8c-4cb2-9468-5a4ac004f318-kube-api-access-2gkqz\") pod \"kuadrant-operator-controller-manager-86878c769f-sdbc7\" (UID: \"d0ce1ea0-df8c-4cb2-9468-5a4ac004f318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" Jul 07 06:50:13.409734 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.409716 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0ce1ea0-df8c-4cb2-9468-5a4ac004f318-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sdbc7\" (UID: \"d0ce1ea0-df8c-4cb2-9468-5a4ac004f318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" Jul 07 06:50:13.427109 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.427063 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gkqz\" (UniqueName: \"kubernetes.io/projected/d0ce1ea0-df8c-4cb2-9468-5a4ac004f318-kube-api-access-2gkqz\") pod \"kuadrant-operator-controller-manager-86878c769f-sdbc7\" (UID: \"d0ce1ea0-df8c-4cb2-9468-5a4ac004f318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" Jul 07 06:50:13.448383 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.448360 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" Jul 07 06:50:13.590162 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:13.590134 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7"] Jul 07 06:50:13.591817 ip-10-0-129-39 kubenswrapper[2575]: W0707 06:50:13.591789 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ce1ea0_df8c_4cb2_9468_5a4ac004f318.slice/crio-7991eb5d6cd2710ca12fda3bcd68a61e46aefec8486b801f849f9b57da1effa0 WatchSource:0}: Error finding container 7991eb5d6cd2710ca12fda3bcd68a61e46aefec8486b801f849f9b57da1effa0: Status 404 returned error can't find the container with id 7991eb5d6cd2710ca12fda3bcd68a61e46aefec8486b801f849f9b57da1effa0 Jul 07 06:50:14.008913 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:14.008877 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" event={"ID":"d0ce1ea0-df8c-4cb2-9468-5a4ac004f318","Type":"ContainerStarted","Data":"e72cc9fcaba235b6dd774a850b9daa71e16818440c6b5ed79d089122c92da86c"} Jul 07 06:50:14.009114 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:14.008931 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" event={"ID":"d0ce1ea0-df8c-4cb2-9468-5a4ac004f318","Type":"ContainerStarted","Data":"7991eb5d6cd2710ca12fda3bcd68a61e46aefec8486b801f849f9b57da1effa0"} Jul 07 06:50:14.009114 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:14.009039 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" Jul 07 06:50:14.029779 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:14.029737 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" podStartSLOduration=1.029717132 podStartE2EDuration="1.029717132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:50:14.027875801 +0000 UTC m=+1127.029955124" watchObservedRunningTime="2026-07-07 06:50:14.029717132 +0000 UTC m=+1127.031796424" Jul 07 06:50:25.015653 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:25.015575 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sdbc7" Jul 07 06:50:34.739518 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:34.739481 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:50:45.848365 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:45.848323 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:50:56.046995 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:50:56.046911 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:51:07.152225 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:51:07.152189 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:51:18.638352 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:51:18.638315 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:51:27.523189 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:51:27.523153 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:51:27.533082 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:51:27.533054 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:51:29.542329 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:51:29.542296 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:51:38.248821 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:51:38.248785 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:51:48.941923 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:51:48.941888 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:52:00.756621 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:52:00.756587 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:52:08.951950 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:52:08.951919 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:52:19.341507 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:52:19.341427 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:52:41.944651 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:52:41.944615 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:52:50.646341 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:52:50.646314 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:53:02.054169 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:53:02.054132 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:53:11.043787 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:53:11.043752 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:53:29.159146 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:53:29.159108 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:53:39.653467 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:53:39.653434 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:53:48.454174 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:53:48.454089 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:54:00.151325 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:54:00.151296 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:54:09.851084 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:54:09.851034 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:54:21.155219 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:54:21.155185 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:54:33.861737 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:54:33.861701 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:54:42.657064 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:54:42.657025 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:54:52.354605 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:54:52.354569 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:55:02.549038 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:55:02.549003 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:55:15.149217 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:55:15.149185 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:55:24.561035 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:55:24.560956 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:55:35.660455 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:55:35.660422 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:55:50.956227 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:55:50.956194 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:56:02.044475 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:56:02.044435 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:56:14.947308 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:56:14.947270 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:56:23.353855 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:56:23.353825 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:56:27.562419 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:56:27.562393 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:56:27.562835 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:56:27.562393 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 06:56:34.547617 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:56:34.547588 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:57:10.554669 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:57:10.554591 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:57:18.956344 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:57:18.956307 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:58:42.952060 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:58:42.951987 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:58:49.456330 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:58:49.456289 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:58:56.859455 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:58:56.859422 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:59:06.350330 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:59:06.350293 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:59:16.450794 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:59:16.450759 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:59:48.249544 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:59:48.249513 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 06:59:59.153014 ip-10-0-129-39 kubenswrapper[2575]: I0707 06:59:59.152980 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:00:12.051398 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:00:12.051367 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:00:25.446419 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:00:25.446384 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:01:05.448315 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:01:05.448267 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:01:19.857207 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:01:19.857127 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:01:27.591232 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:01:27.591202 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 07:01:27.593205 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:01:27.593184 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 07:01:28.850320 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:01:28.850289 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:02:13.756468 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:02:13.756431 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:02:25.253841 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:02:25.253802 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:02:46.678535 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:02:46.678500 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:02:56.447344 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:02:56.447267 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:03:17.767657 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:03:17.767620 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:03:30.158214 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:03:30.158181 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:03:42.952261 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:03:42.952228 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:04:27.234653 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:04:27.234580 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:04:38.547208 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:04:38.547171 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:04:47.043112 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:04:47.043062 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:04:58.248471 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:04:58.248435 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:05:10.274696 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:05:10.274662 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:05:21.214230 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:05:21.214197 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:05:31.586391 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:05:31.586352 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:05:47.571820 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:05:47.571781 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:06:27.619265 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:06:27.619234 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 07:06:27.622259 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:06:27.622232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 07:06:33.844704 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:06:33.844668 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:06:52.262221 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:06:52.262191 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:07:09.063485 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:07:09.063451 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:07:22.758724 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:07:22.758647 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:07:39.076502 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:07:39.076469 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:07:56.557187 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:07:56.557150 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:08:13.196665 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:08:13.196629 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:08:28.766364 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:08:28.766331 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:08:44.654260 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:08:44.654227 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:08:59.670621 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:08:59.670534 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:09:58.543318 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:09:58.543280 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:10:12.258193 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:10:12.258153 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:10:31.949532 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:10:31.949452 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:10:45.944162 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:10:45.944131 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:11:19.149896 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:11:19.149860 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:11:27.646838 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:11:27.646808 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 07:11:27.651890 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:11:27.651870 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 07:11:37.259397 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:11:37.259364 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:11:50.963637 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:11:50.963557 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:12:03.948787 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:03.948759 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:12:46.950325 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:46.950290 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k2cm4"] Jul 07 07:12:51.210291 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:51.210249 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-74b96f99f7-2km6g_ea6accee-090b-4643-b5a4-2202aff9c209/authorino/0.log" Jul 07 07:12:55.902468 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:55.902435 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sfpvk_2551a29f-1db7-47e3-94d8-c4ea86eb47e1/manager/0.log" Jul 07 07:12:56.403769 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:56.403740 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2zzfh_b5a46271-f02e-4705-8ef4-4557ec55ed97/server/0.log" Jul 07 07:12:56.522489 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:56.522446 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dsndp_41f4a357-bbcb-4450-8af7-b25d3a8e555c/manager/0.log" Jul 07 07:12:56.642552 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:56.642526 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c66c8b568-7vdv9_d729752d-06f0-4c3e-afc3-af5471659a1f/copy-manifests/0.log" Jul 07 07:12:56.655960 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:56.655876 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c66c8b568-7vdv9_d729752d-06f0-4c3e-afc3-af5471659a1f/manager/0.log" Jul 07 07:12:58.289952 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:58.289918 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-74b96f99f7-2km6g_ea6accee-090b-4643-b5a4-2202aff9c209/authorino/0.log" Jul 07 07:12:58.413806 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:58.413777 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4ldhk_94d8af56-5709-4160-abf4-164b3683a68a/manager/0.log" Jul 07 07:12:58.527301 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:58.527269 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mlw66_aa70eb02-6cdd-4aed-96e9-6d9a179db64b/manager/0.log" Jul 07 07:12:58.757656 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:58.757629 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bhskh_aa14b351-18c7-49d1-bdbc-5f9c23495210/registry-server/0.log" Jul 07 07:12:58.872429 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:58.872401 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sdbc7_d0ce1ea0-df8c-4cb2-9468-5a4ac004f318/manager/0.log" Jul 07 07:12:58.995308 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:58.995276 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-k2cm4_0bdb275a-0a4e-4d15-bdba-26bd36e51e9d/limitador/0.log" Jul 07 07:12:59.110203 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:59.110114 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7s4vm_7b36fac1-043f-4ec5-acfb-a5ef5edb8f21/manager/0.log" Jul 07 07:12:59.716087 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:12:59.716039 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74994db979-dhb5f_903ff31c-72f6-4d9c-99e7-c6c09d7ef574/kube-auth-proxy/0.log" Jul 07 07:13:00.309019 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:00.308993 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9cd96565c-krjmm_cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6/router/0.log" Jul 07 07:13:00.761762 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:00.761719 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-xvw4s_026fbee8-8bb7-4a78-8e7d-1aa0664bf412/main/0.log" Jul 07 07:13:01.005113 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:01.005059 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdm6rh_52d20cc6-815e-4e22-b0d1-bce2c4b99a05/main/0.log" Jul 07 07:13:08.448496 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:08.448460 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zmwbj_cd3ac366-ff6b-4aab-822a-c9dbfbd4f5b3/global-pull-secret-syncer/0.log" Jul 07 07:13:08.531091 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:08.531038 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-drc6p_90d97f41-cf09-4bde-aab1-b29ab0050234/konnectivity-agent/0.log" Jul 07 07:13:08.584796 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:08.584776 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-39.ec2.internal_9178fa6a4c12c534b2a4b3275d3b9775/haproxy/0.log" Jul 07 07:13:13.029384 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:13.029342 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-74b96f99f7-2km6g_ea6accee-090b-4643-b5a4-2202aff9c209/authorino/0.log" Jul 07 07:13:13.068789 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:13.068765 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4ldhk_94d8af56-5709-4160-abf4-164b3683a68a/manager/0.log" Jul 07 07:13:13.090804 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:13.090780 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mlw66_aa70eb02-6cdd-4aed-96e9-6d9a179db64b/manager/0.log" Jul 07 07:13:13.152465 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:13.152441 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bhskh_aa14b351-18c7-49d1-bdbc-5f9c23495210/registry-server/0.log" Jul 07 07:13:13.306233 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:13.306150 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sdbc7_d0ce1ea0-df8c-4cb2-9468-5a4ac004f318/manager/0.log" Jul 07 07:13:13.344871 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:13.344844 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-k2cm4_0bdb275a-0a4e-4d15-bdba-26bd36e51e9d/limitador/0.log" Jul 07 07:13:13.409439 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:13.409415 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7s4vm_7b36fac1-043f-4ec5-acfb-a5ef5edb8f21/manager/0.log" Jul 07 07:13:15.034122 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:15.034066 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-4q4s2_45c8dce0-8403-463a-80bf-e6a7c6dceed2/cluster-monitoring-operator/0.log" Jul 07 07:13:15.515592 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:15.515561 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pkqvk_e45da2aa-c340-4006-8568-763fe9309290/node-exporter/0.log" Jul 07 07:13:15.536658 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:15.536636 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pkqvk_e45da2aa-c340-4006-8568-763fe9309290/kube-rbac-proxy/0.log" Jul 07 07:13:15.574078 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:15.574058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pkqvk_e45da2aa-c340-4006-8568-763fe9309290/init-textfile/0.log" Jul 07 07:13:17.585113 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:17.585085 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-rqhct_6da6b9f0-0545-485d-9c49-5dea39058520/networking-console-plugin/0.log" Jul 07 07:13:18.186856 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.186825 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/1.log" Jul 07 07:13:18.191914 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.191877 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cnh47_f61f4023-948b-4a84-86a9-0ec309718b46/console-operator/2.log" Jul 07 07:13:18.768537 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.768503 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v"] Jul 07 07:13:18.772323 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.772300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.776330 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.776303 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f8h84\"/\"default-dockercfg-xq6kg\"" Jul 07 07:13:18.776454 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.776350 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f8h84\"/\"kube-root-ca.crt\"" Jul 07 07:13:18.777408 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.777386 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f8h84\"/\"openshift-service-ca.crt\"" Jul 07 07:13:18.786595 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.786576 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-6q8w6_a6f7e13c-8773-438a-bc34-49dcd380ff4a/download-server/0.log" Jul 07 07:13:18.787782 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.787762 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v"] Jul 07 07:13:18.853242 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.853196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-proc\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.853242 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.853242 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9drb9\" (UniqueName: \"kubernetes.io/projected/84275fab-b873-47bc-9060-489ef4316b57-kube-api-access-9drb9\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.853417 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.853286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-sys\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.853417 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.853312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-lib-modules\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.853417 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.853334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-podres\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.954207 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.954177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-proc\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.954207 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.954208 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9drb9\" (UniqueName: \"kubernetes.io/projected/84275fab-b873-47bc-9060-489ef4316b57-kube-api-access-9drb9\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.954424 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.954260 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-sys\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.954424 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.954277 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-lib-modules\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.954424 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.954294 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-podres\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.954424 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.954304 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-proc\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.954424 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.954370 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-sys\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.954424 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.954416 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-podres\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.954637 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.954424 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84275fab-b873-47bc-9060-489ef4316b57-lib-modules\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:18.963597 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:18.963576 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9drb9\" (UniqueName: \"kubernetes.io/projected/84275fab-b873-47bc-9060-489ef4316b57-kube-api-access-9drb9\") pod \"perf-node-gather-daemonset-lc22v\" (UID: \"84275fab-b873-47bc-9060-489ef4316b57\") " pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:19.083755 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:19.083688 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:19.222617 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:19.222593 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v"] Jul 07 07:13:19.225800 ip-10-0-129-39 kubenswrapper[2575]: W0707 07:13:19.225778 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84275fab_b873_47bc_9060_489ef4316b57.slice/crio-e5197e73a85a707139a01609b39f22dda540c8e4152f739232a51624a822a54b WatchSource:0}: Error finding container e5197e73a85a707139a01609b39f22dda540c8e4152f739232a51624a822a54b: Status 404 returned error can't find the container with id e5197e73a85a707139a01609b39f22dda540c8e4152f739232a51624a822a54b Jul 07 07:13:19.518127 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:19.518104 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-fvl2q_23d1165d-f14c-4f68-a463-ee69c76007d0/volume-data-source-validator/0.log" Jul 07 07:13:19.784571 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:19.784489 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" event={"ID":"84275fab-b873-47bc-9060-489ef4316b57","Type":"ContainerStarted","Data":"42c18583c705df55bcdafe2f4062e670446b67d3344887516e4be31293db9344"} Jul 07 07:13:19.784571 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:19.784537 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" event={"ID":"84275fab-b873-47bc-9060-489ef4316b57","Type":"ContainerStarted","Data":"e5197e73a85a707139a01609b39f22dda540c8e4152f739232a51624a822a54b"} Jul 07 07:13:19.784969 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:19.784612 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:19.816991 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:19.816948 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" podStartSLOduration=1.816929963 podStartE2EDuration="1.816929963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 07:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:13:19.815057872 +0000 UTC m=+2512.817137185" watchObservedRunningTime="2026-07-07 07:13:19.816929963 +0000 UTC m=+2512.819009279" Jul 07 07:13:20.763818 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:20.763797 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l6pcn_fd8c291f-b8db-4725-97fd-cbb92e48d483/dns/0.log" Jul 07 07:13:20.798006 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:20.797983 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l6pcn_fd8c291f-b8db-4725-97fd-cbb92e48d483/kube-rbac-proxy/0.log" Jul 07 07:13:20.916876 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:20.916854 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j8bqh_e3b3ec4a-096e-4f79-9637-0a030bbeb608/dns-node-resolver/0.log" Jul 07 07:13:21.634601 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:21.634563 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r949v_39efcee3-3895-4b99-883c-273bba95191b/node-ca/0.log" Jul 07 07:13:22.790129 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:22.790103 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74994db979-dhb5f_903ff31c-72f6-4d9c-99e7-c6c09d7ef574/kube-auth-proxy/0.log" Jul 07 07:13:23.008744 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:23.008715 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9cd96565c-krjmm_cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6/router/0.log" Jul 07 07:13:23.712035 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:23.712009 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jsbmz_d3e1680c-1cc4-4edc-9548-d925aacfe2de/serve-healthcheck-canary/0.log" Jul 07 07:13:24.210456 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:24.210409 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-2rvvr_afb4af7c-3cca-4635-afde-dbb8e92d2664/insights-operator/0.log" Jul 07 07:13:24.210828 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:24.210787 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-2rvvr_afb4af7c-3cca-4635-afde-dbb8e92d2664/insights-operator/1.log" Jul 07 07:13:24.229102 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:24.229068 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxb9r_16df1bc4-8617-4445-891e-7649c7bff13e/kube-rbac-proxy/0.log" Jul 07 07:13:24.248934 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:24.248913 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxb9r_16df1bc4-8617-4445-891e-7649c7bff13e/exporter/0.log" Jul 07 07:13:24.267833 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:24.267815 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxb9r_16df1bc4-8617-4445-891e-7649c7bff13e/extractor/0.log" Jul 07 07:13:25.798909 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:25.798885 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f8h84/perf-node-gather-daemonset-lc22v" Jul 07 07:13:26.480972 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:26.480949 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sfpvk_2551a29f-1db7-47e3-94d8-c4ea86eb47e1/manager/0.log" Jul 07 07:13:26.882119 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:26.882020 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2zzfh_b5a46271-f02e-4705-8ef4-4557ec55ed97/server/0.log" Jul 07 07:13:26.948916 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:26.948889 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dsndp_41f4a357-bbcb-4450-8af7-b25d3a8e555c/manager/0.log" Jul 07 07:13:27.021521 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:27.021492 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c66c8b568-7vdv9_d729752d-06f0-4c3e-afc3-af5471659a1f/manager/0.log" Jul 07 07:13:27.035589 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:27.035568 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c66c8b568-7vdv9_d729752d-06f0-4c3e-afc3-af5471659a1f/copy-manifests/0.log" Jul 07 07:13:28.998299 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:28.998267 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74994db979-dhb5f_903ff31c-72f6-4d9c-99e7-c6c09d7ef574/kube-auth-proxy/0.log" Jul 07 07:13:29.178163 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:29.178139 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9cd96565c-krjmm_cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6/router/0.log" Jul 07 07:13:30.513601 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:30.513526 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74994db979-dhb5f_903ff31c-72f6-4d9c-99e7-c6c09d7ef574/kube-auth-proxy/0.log" Jul 07 07:13:30.712085 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:30.712053 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9cd96565c-krjmm_cb85eca7-63d2-4843-b5e9-1a5a83ba9bd6/router/0.log" Jul 07 07:13:33.892505 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:33.892480 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-r9x4p_34727dcf-7b79-4bf8-8dbf-cca339c19b09/migrator/0.log" Jul 07 07:13:33.913369 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:33.913344 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-r9x4p_34727dcf-7b79-4bf8-8dbf-cca339c19b09/graceful-termination/0.log" Jul 07 07:13:34.266505 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:34.266476 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-kdbpq_f0cf7c7a-b953-48f5-9e11-a579660d707f/kube-storage-version-migrator-operator/1.log" Jul 07 07:13:34.267567 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:34.267547 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-kdbpq_f0cf7c7a-b953-48f5-9e11-a579660d707f/kube-storage-version-migrator-operator/0.log" Jul 07 07:13:35.704202 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:35.704172 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwkn7_16ab1acc-1355-4186-b4e0-51fbf6241b3b/kube-multus-additional-cni-plugins/0.log" Jul 07 07:13:35.724840 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:35.724817 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwkn7_16ab1acc-1355-4186-b4e0-51fbf6241b3b/egress-router-binary-copy/0.log" Jul 07 07:13:35.743647 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:35.743629 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwkn7_16ab1acc-1355-4186-b4e0-51fbf6241b3b/cni-plugins/0.log" Jul 07 07:13:35.762668 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:35.762647 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwkn7_16ab1acc-1355-4186-b4e0-51fbf6241b3b/bond-cni-plugin/0.log" Jul 07 07:13:35.782609 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:35.782590 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwkn7_16ab1acc-1355-4186-b4e0-51fbf6241b3b/routeoverride-cni/0.log" Jul 07 07:13:35.801028 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:35.801009 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwkn7_16ab1acc-1355-4186-b4e0-51fbf6241b3b/whereabouts-cni-bincopy/0.log" Jul 07 07:13:35.819485 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:35.819462 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwkn7_16ab1acc-1355-4186-b4e0-51fbf6241b3b/whereabouts-cni/0.log" Jul 07 07:13:35.877811 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:35.877776 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pqq72_0e5527f6-1a0f-477a-8f94-b91c8f810269/kube-multus/0.log" Jul 07 07:13:35.934437 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:35.934405 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ph8qs_bc2b4af1-d047-4ad8-8951-c1a020da2030/network-metrics-daemon/0.log" Jul 07 07:13:35.951850 ip-10-0-129-39 kubenswrapper[2575]: I0707 07:13:35.951832 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ph8qs_bc2b4af1-d047-4ad8-8951-c1a020da2030/kube-rbac-proxy/0.log"