Jul 06 23:58:12.452519 ip-10-0-142-126 systemd[1]: Starting Kubernetes Kubelet... Jul 06 23:58:12.887128 ip-10-0-142-126 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:58:12.887128 ip-10-0-142-126 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 23:58:12.887128 ip-10-0-142-126 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:58:12.887128 ip-10-0-142-126 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 23:58:12.887128 ip-10-0-142-126 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:58:12.888055 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.887969 2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 23:58:12.893757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893737 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:12.893757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893752 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:12.893757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893756 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:12.893757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893759 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:12.893757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893763 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:12.893757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893767 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893770 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893773 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893776 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893779 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893782 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893785 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893788 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893791 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893794 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893797 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893800 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893803 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893805 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893808 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893811 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893814 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893827 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893830 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893833 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:12.894057 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893836 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893839 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893843 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893845 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893848 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893851 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893853 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893856 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893859 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893862 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893865 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893867 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893870 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893873 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893876 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893880 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893882 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893886 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893889 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893892 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:12.894880 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893894 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893897 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893901 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893903 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893906 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893909 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893911 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893914 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893917 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893921 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893925 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893928 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893932 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893935 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893937 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893941 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893944 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893946 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893949 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:12.895757 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893951 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893954 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893957 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893959 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893962 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893965 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893968 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893971 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893973 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893978 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893981 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893985 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893990 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893993 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893996 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.893999 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894002 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894007 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894010 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:12.896544 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894013 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894016 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894019 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894021 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894024 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894027 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894029 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894032 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894035 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894037 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894040 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894042 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894045 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894048 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894051 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.894054 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897231 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897239 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897243 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897247 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:12.897332 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897250 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897253 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897256 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897259 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897262 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897265 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897267 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897270 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897273 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897275 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897279 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897281 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897284 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897287 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897291 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897294 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897310 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897313 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897317 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897320 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:12.898189 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897323 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897326 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897329 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897331 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897334 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897337 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897340 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897343 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897346 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897349 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897352 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897355 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897358 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897360 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897363 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897366 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897368 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897371 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897373 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897376 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:12.899092 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897379 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897382 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897385 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897389 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897392 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897394 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897398 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897403 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897407 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897410 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897413 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897416 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897419 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897421 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897424 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897427 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897429 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897432 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897434 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897437 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:12.899930 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897440 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897442 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897445 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897448 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897450 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897453 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897456 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897458 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897461 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897464 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897467 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897471 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897475 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897478 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897481 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897484 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897488 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897491 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897494 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897497 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:12.900774 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897499 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897502 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897506 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897510 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897513 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897516 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897519 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897522 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897524 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897527 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897530 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897533 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897535 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897538 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897541 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897954 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897960 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897962 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897966 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897969 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:12.901621 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897972 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897974 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897978 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897981 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897983 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897986 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897989 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897992 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897995 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.897998 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898001 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898003 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898006 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898009 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898012 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898014 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898017 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898019 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898023 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898025 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:12.902460 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898028 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898031 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898034 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898036 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898039 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898042 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898045 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898048 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898050 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898053 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898055 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898058 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898061 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898064 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898067 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898070 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898073 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898076 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898079 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898081 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:12.903263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898084 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898087 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898090 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898092 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898095 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898098 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898101 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898103 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898106 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898108 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898111 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898114 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898116 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898120 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898123 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898125 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898128 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898130 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898133 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:12.904095 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898139 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898143 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898147 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898149 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898152 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898155 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898158 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898161 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898164 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898166 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898169 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898172 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898175 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898177 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898180 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898183 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898188 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898191 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898194 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:12.904890 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898198 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898201 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898204 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898207 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898210 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898213 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898215 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898218 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898221 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898223 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898226 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898228 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898231 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898234 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898238 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898241 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898327 2549 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898335 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898343 2549 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898348 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898358 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 23:58:12.905675 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898361 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898365 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898370 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898373 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898376 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898380 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898383 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898387 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898391 2549 flags.go:64] FLAG: --cgroup-root="" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898394 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898397 2549 flags.go:64] FLAG: --client-ca-file="" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898400 2549 flags.go:64] FLAG: --cloud-provider="external" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898403 2549 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898407 2549 flags.go:64] FLAG: --cluster-domain="" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898410 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898414 2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898417 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898420 2549 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898424 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898427 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898431 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898434 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898438 2549 flags.go:64] FLAG: --contention-profiling="false" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898441 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 23:58:12.906554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898445 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898448 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898451 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898456 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898459 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898464 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898467 2549 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898470 2549 flags.go:64] FLAG: --enable-server="true" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898473 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898478 2549 flags.go:64] FLAG: --event-burst="100" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898481 2549 flags.go:64] FLAG: --event-qps="50" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898485 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898488 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898491 2549 flags.go:64] FLAG: --eviction-hard="" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898495 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898498 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898501 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898505 2549 flags.go:64] FLAG: --eviction-soft="" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898507 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898510 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898514 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898517 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898520 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898522 2549 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898525 2549 flags.go:64] FLAG: --feature-gates="" Jul 06 23:58:12.907652 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898529 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898532 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898535 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898538 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898541 2549 flags.go:64] FLAG: --healthz-port="10248" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898544 2549 flags.go:64] FLAG: --help="false" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898548 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-142-126.ec2.internal" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898551 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898554 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898558 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898561 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898565 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898570 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898573 2549 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898575 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898579 2549 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898582 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898585 2549 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898588 2549 flags.go:64] FLAG: --kube-reserved="" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898591 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898594 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898597 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898600 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898603 2549 flags.go:64] FLAG: --lock-file="" Jul 06 23:58:12.908607 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898606 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898609 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898612 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898618 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898621 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898624 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898627 2549 flags.go:64] FLAG: --logging-format="text" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898629 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898633 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898636 2549 flags.go:64] FLAG: --manifest-url="" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898639 2549 flags.go:64] FLAG: --manifest-url-header="" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898643 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898646 2549 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898650 2549 flags.go:64] FLAG: --max-pods="110" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898653 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898656 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898659 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898662 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898665 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898669 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898673 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898680 2549 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898684 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898687 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 23:58:12.909236 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898690 2549 flags.go:64] FLAG: --pod-cidr="" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898693 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898699 2549 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898701 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898705 2549 flags.go:64] FLAG: --pods-per-core="0" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898708 2549 flags.go:64] FLAG: --port="10250" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898711 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898714 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00496be79ff08cc02" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898717 2549 flags.go:64] FLAG: --qos-reserved="" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898720 2549 flags.go:64] FLAG: --read-only-port="10255" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898724 2549 flags.go:64] FLAG: --register-node="true" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898727 2549 flags.go:64] FLAG: --register-with-taints="" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898731 2549 flags.go:64] FLAG: --registry-burst="10" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898734 2549 flags.go:64] FLAG: --registry-qps="5" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898736 2549 flags.go:64] FLAG: --reserved-cpus="" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898740 2549 flags.go:64] FLAG: --reserved-memory="" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898744 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898747 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898750 2549 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898753 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898756 2549 flags.go:64] FLAG: --runonce="false" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898759 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898762 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898767 2549 flags.go:64] FLAG: --seccomp-default="false" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898770 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 23:58:12.909951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898773 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898776 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898779 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898782 2549 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898787 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898790 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898793 2549 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898796 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898799 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898802 2549 flags.go:64] FLAG: --system-cgroups="" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898805 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898810 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898813 2549 flags.go:64] FLAG: --tls-cert-file="" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898816 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898820 2549 flags.go:64] FLAG: --tls-min-version="" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898823 2549 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898826 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898829 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898833 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898836 2549 flags.go:64] FLAG: --v="2" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898840 2549 flags.go:64] FLAG: --version="false" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898844 2549 flags.go:64] FLAG: --vmodule="" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898847 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.898851 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898966 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:12.910634 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898971 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898974 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898978 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898981 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898984 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898989 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898993 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898996 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.898998 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899001 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899004 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899008 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899011 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899014 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899016 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899019 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899022 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899024 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899027 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899030 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:12.911343 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899033 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899036 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899038 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899041 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899044 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899047 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899050 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899052 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899055 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899058 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899060 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899063 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899066 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899068 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899072 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899077 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899082 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899087 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899090 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:12.911894 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899094 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899097 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899100 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899102 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899107 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899110 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899113 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899116 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899118 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899121 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899124 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899126 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899129 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899132 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899135 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899137 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899140 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899143 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899145 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:12.912453 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899148 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899151 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899154 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899157 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899160 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899162 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899165 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899168 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899171 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899173 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899176 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899181 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899184 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899187 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899189 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899192 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899196 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899201 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899204 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899207 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:12.912951 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899210 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899213 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899216 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899219 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899222 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899225 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899228 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899231 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899233 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899236 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899239 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899242 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899245 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899247 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899250 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899253 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899256 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899258 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899261 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:12.913543 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.899264 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.899273 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.906266 2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.906281 2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.906318 2549 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.906325 2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906383 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906388 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906392 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906395 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906398 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906401 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906404 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906407 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906410 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:12.914039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906421 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906424 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906427 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906430 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906433 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906436 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906439 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906441 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906444 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906447 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906450 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906452 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906455 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906458 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906461 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906464 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906466 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906469 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906472 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906474 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:12.914526 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906480 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906483 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906486 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906489 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906492 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906494 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906497 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906500 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906502 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906505 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906508 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906511 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906513 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906516 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906519 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906521 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906524 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906527 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906529 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:12.915252 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906532 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906534 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906537 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906540 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906543 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906546 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906549 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906553 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906557 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906560 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906564 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906568 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906572 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906576 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906579 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906582 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906585 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906588 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906591 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:12.915783 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906593 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906596 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906599 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906601 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906604 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906607 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906610 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906612 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906615 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906618 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906621 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906623 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906626 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906629 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906631 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906635 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906639 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906642 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906645 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:12.916334 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906648 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906651 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906654 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906657 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906660 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906663 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906665 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906668 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906671 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906674 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906677 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906680 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906682 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.906688 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906812 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:58:12.916969 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906818 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906821 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906824 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906827 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906830 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906833 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906836 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906839 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906841 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906844 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906847 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906849 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906852 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906855 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906858 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906861 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906864 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906866 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906870 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906874 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:58:12.917742 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906877 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906880 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906883 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906887 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906889 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906892 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906895 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906899 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906901 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906904 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906906 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906909 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906912 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906914 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906917 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906919 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906922 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906925 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906928 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906931 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:58:12.918263 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906933 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906936 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906938 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906941 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906944 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906946 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906949 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906952 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906954 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906957 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906959 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906962 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906964 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906967 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906969 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906972 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906975 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906978 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906981 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906983 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:58:12.918811 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906986 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906989 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906992 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906994 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906997 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.906999 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907002 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907005 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907007 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907010 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907012 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907018 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907021 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907023 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907026 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907029 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907031 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907034 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907036 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907039 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:58:12.919527 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907042 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907044 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907047 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907049 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907052 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907055 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907059 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907062 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907065 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907068 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907070 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907073 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907076 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907080 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907084 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907087 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907090 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:58:12.920046 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:12.907093 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:58:12.920513 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.907098 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:58:12.920513 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.907201 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 23:58:12.920513 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.909378 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 23:58:12.920513 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.910876 2549 server.go:1019] "Starting client certificate rotation" Jul 06 23:58:12.920513 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.910983 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:58:12.920513 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.911018 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:58:12.920513 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.913336 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:58:12.920513 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.919127 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:58:12.933785 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.933766 2549 log.go:25] "Validated CRI v1 runtime API" Jul 06 23:58:12.936496 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.936480 2549 log.go:25] "Validated CRI v1 image API" Jul 06 23:58:12.937332 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.937314 2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 23:58:12.942335 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.942319 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:58:12.943981 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.943951 2549 fs.go:135] Filesystem UUIDs: map[2a6c32b2-bf3f-4f7c-ac15-40e2147faee9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8eef0420-fb87-4b9d-92f0-786c08d24ff9:/dev/nvme0n1p3] Jul 06 23:58:12.944040 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.943982 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 23:58:12.949475 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.949359 2549 manager.go:216] Machine: {Timestamp:2026-07-06 23:58:12.947927733 +0000 UTC m=+0.378348488 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094395 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26d4929fb19523998007afb76e8ad2 SystemUUID:ec26d492-9fb1-9523-9980-07afb76e8ad2 BootID:f1809e70-8994-4266-91c7-df7b9af119ac Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:eb:90:17:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:eb:90:17:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:87:e0:20:86:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 23:58:12.949475 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.949468 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 23:58:12.949584 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.949546 2549 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 23:58:12.952527 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.952502 2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 23:58:12.952681 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.952530 2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-126.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 23:58:12.953310 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.953288 2549 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 23:58:12.953350 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.953315 2549 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 23:58:12.953350 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.953323 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:58:12.954277 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.954265 2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:58:12.955602 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.955592 2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 23:58:12.958546 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.958534 2549 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:58:12.958668 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.958658 2549 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 23:58:12.958703 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.958689 2549 kubelet.go:486] "Attempting to sync node with API server" Jul 06 23:58:12.958733 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.958706 2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 23:58:12.958733 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.958718 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 23:58:12.958733 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.958727 2549 kubelet.go:398] "Adding apiserver pod source" Jul 06 23:58:12.958843 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.958736 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 23:58:12.959115 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.959095 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:58:12.959174 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.959132 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:58:12.962425 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.962406 2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 23:58:12.964487 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.964473 2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 23:58:12.964545 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.964506 2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 23:58:12.965990 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.965971 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 23:58:12.966102 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.965997 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 23:58:12.966102 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.966008 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 23:58:12.966102 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.966018 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 23:58:12.966102 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.966032 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 23:58:12.966102 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.966041 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 23:58:12.966102 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.966055 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 23:58:12.966102 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.966064 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 23:58:12.966102 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.966074 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 23:58:12.966102 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.966084 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 23:58:12.966420 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.966121 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 23:58:12.966420 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.966131 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 23:58:12.967098 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.967077 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 23:58:12.967098 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.967097 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 23:58:12.971809 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.971781 2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-126.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 23:58:12.971896 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:12.971817 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 23:58:12.971896 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:12.971815 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 23:58:12.972240 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.972225 2549 server.go:1268] "Started kubelet" Jul 06 23:58:12.972345 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.972314 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 23:58:12.972435 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.972376 2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 23:58:12.972502 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.972448 2549 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 23:58:12.973298 ip-10-0-142-126 systemd[1]: Started Kubernetes Kubelet. Jul 06 23:58:12.974208 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.974125 2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 23:58:12.974266 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.974229 2549 server.go:310] "Adding debug handlers to kubelet server" Jul 06 23:58:12.978800 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:12.978781 2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 23:58:12.981100 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.981081 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 23:58:12.981212 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.981084 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 23:58:12.981212 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:12.981174 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:12.981495 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:12.980521 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-126.ec2.internal.18bfd8bf27544e4b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-126.ec2.internal,UID:ip-10-0-142-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-126.ec2.internal,},FirstTimestamp:2026-07-06 23:58:12.972195403 +0000 UTC m=+0.402616158,LastTimestamp:2026-07-06 23:58:12.972195403 +0000 UTC m=+0.402616158,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-126.ec2.internal,}" Jul 06 23:58:12.982056 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.982036 2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 23:58:12.982056 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.982036 2549 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 23:58:12.982191 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.982069 2549 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 23:58:12.982191 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.982161 2549 reconstruct.go:97] "Volume reconstruction finished" Jul 06 23:58:12.982191 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.982169 2549 reconciler.go:29] "Reconciler: start to sync state" Jul 06 23:58:12.984115 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.983497 2549 factory.go:55] Registering systemd factory Jul 06 23:58:12.984115 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.983518 2549 factory.go:223] Registration of the systemd container factory successfully Jul 06 23:58:12.984115 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.983836 2549 factory.go:153] Registering CRI-O factory Jul 06 23:58:12.984115 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.983852 2549 factory.go:223] Registration of the crio container factory successfully Jul 06 23:58:12.984115 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.983906 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 23:58:12.984115 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.983931 2549 factory.go:103] Registering Raw factory Jul 06 23:58:12.984115 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.983946 2549 manager.go:1196] Started watching for new ooms in manager Jul 06 23:58:12.984620 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.984400 2549 manager.go:349] Starting recovery of all containers Jul 06 23:58:12.988226 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:12.988197 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 23:58:12.988350 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:12.988322 2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 23:58:12.995699 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.995549 2549 manager.go:354] Recovery completed Jul 06 23:58:12.996198 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:12.996183 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kmtgs" Jul 06 23:58:13.002149 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.002135 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:13.004130 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.004112 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:13.004187 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.004150 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:13.004187 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.004167 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:13.004487 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.004459 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kmtgs" Jul 06 23:58:13.004763 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.004749 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 23:58:13.004763 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.004764 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 23:58:13.004870 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.004783 2549 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:58:13.004870 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.004763 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:13.005658 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.005642 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:13.005721 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.005671 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:13.005721 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.005682 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:13.005847 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.005835 2549 policy_none.go:49] "None policy: Start" Jul 06 23:58:13.005884 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.005851 2549 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 23:58:13.005884 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.005862 2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 23:58:13.006323 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.006190 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-126.ec2.internal.18bfd8bf293b9e30 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-126.ec2.internal,UID:ip-10-0-142-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-126.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-126.ec2.internal,},FirstTimestamp:2026-07-06 23:58:13.004131888 +0000 UTC m=+0.434552651,LastTimestamp:2026-07-06 23:58:13.004131888 +0000 UTC m=+0.434552651,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-126.ec2.internal,}" Jul 06 23:58:13.006805 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.006793 2549 policy_none.go:47] "Start" Jul 06 23:58:13.044879 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.044865 2549 manager.go:337] "Starting Device Plugin manager" Jul 06 23:58:13.044994 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.044903 2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 23:58:13.044994 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.044913 2549 server.go:87] "Starting device plugin registration server" Jul 06 23:58:13.045159 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.045145 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 23:58:13.045217 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.045163 2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 23:58:13.045283 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.045272 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 23:58:13.045388 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.045375 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 23:58:13.045437 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.045390 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 23:58:13.045838 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.045816 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 23:58:13.045935 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.045871 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:13.083733 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.083707 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 23:58:13.084892 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.084875 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 23:58:13.084995 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.084921 2549 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 23:58:13.084995 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.084947 2549 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 23:58:13.084995 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.084987 2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 23:58:13.087611 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.087592 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:13.147590 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.147520 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:13.151834 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.151814 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:13.151928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.151852 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:13.151928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.151869 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:13.151928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.151897 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.160052 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.160031 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.160110 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.160052 2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-126.ec2.internal\": node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:13.185551 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.185532 2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal"] Jul 06 23:58:13.185616 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.185586 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:13.187187 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.187166 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:13.187294 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.187196 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:13.187294 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.187212 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:13.188347 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.188334 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:13.188497 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.188472 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.188578 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.188509 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:13.189642 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.189625 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:13.190542 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.190529 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:13.190596 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.190554 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:13.190596 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.190568 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:13.190670 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.190597 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:13.190670 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.190622 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:13.190670 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.190636 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:13.191795 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.191782 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.191838 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.191810 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:58:13.192592 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.192576 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:58:13.192672 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.192604 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:58:13.192672 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.192617 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:58:13.210858 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.210838 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-126.ec2.internal\" not found" node="ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.214588 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.214572 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-126.ec2.internal\" not found" node="ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.283676 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.283653 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c484925f8d284c178719cc07b93a5386-config\") pod \"kube-apiserver-proxy-ip-10-0-142-126.ec2.internal\" (UID: \"c484925f8d284c178719cc07b93a5386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.283781 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.283677 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5169869ecca979b9c375118c6ce6471c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"5169869ecca979b9c375118c6ce6471c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.283781 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.283697 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5169869ecca979b9c375118c6ce6471c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"5169869ecca979b9c375118c6ce6471c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.289882 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.289861 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:13.384779 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.384738 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5169869ecca979b9c375118c6ce6471c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"5169869ecca979b9c375118c6ce6471c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.384779 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.384785 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5169869ecca979b9c375118c6ce6471c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"5169869ecca979b9c375118c6ce6471c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.384953 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.384808 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c484925f8d284c178719cc07b93a5386-config\") pod \"kube-apiserver-proxy-ip-10-0-142-126.ec2.internal\" (UID: \"c484925f8d284c178719cc07b93a5386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.384953 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.384820 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5169869ecca979b9c375118c6ce6471c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"5169869ecca979b9c375118c6ce6471c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.384953 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.384852 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c484925f8d284c178719cc07b93a5386-config\") pod \"kube-apiserver-proxy-ip-10-0-142-126.ec2.internal\" (UID: \"c484925f8d284c178719cc07b93a5386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.384953 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.384881 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5169869ecca979b9c375118c6ce6471c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"5169869ecca979b9c375118c6ce6471c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.390977 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.390950 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:13.491216 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.491175 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:13.514612 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.514582 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.517383 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.517368 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 06 23:58:13.592050 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.592013 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:13.693147 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.693117 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:13.794250 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.794164 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:13.894300 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.894271 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:13.910648 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.910618 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 23:58:13.910780 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.910762 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 23:58:13.942248 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:13.942218 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:13.994624 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:13.994583 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:14.006816 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.006788 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:53:13 +0000 UTC" deadline="2028-03-17 00:39:29.627629872 +0000 UTC" Jul 06 23:58:14.006884 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.006816 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14856h41m15.620816457s" Jul 06 23:58:14.095215 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:14.095146 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:14.152418 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:14.152371 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5169869ecca979b9c375118c6ce6471c.slice/crio-1e3530dc3929ec791638e2e752d289e748d0dd3f279871f2376d18a1dab2ab3b WatchSource:0}: Error finding container 1e3530dc3929ec791638e2e752d289e748d0dd3f279871f2376d18a1dab2ab3b: Status 404 returned error can't find the container with id 1e3530dc3929ec791638e2e752d289e748d0dd3f279871f2376d18a1dab2ab3b Jul 06 23:58:14.152940 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:14.152914 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc484925f8d284c178719cc07b93a5386.slice/crio-a254fb49f437c4189a2d002e3afd0f0ad583df053c8491836f5db97a13b4a6e4 WatchSource:0}: Error finding container a254fb49f437c4189a2d002e3afd0f0ad583df053c8491836f5db97a13b4a6e4: Status 404 returned error can't find the container with id a254fb49f437c4189a2d002e3afd0f0ad583df053c8491836f5db97a13b4a6e4 Jul 06 23:58:14.159928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.159909 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:58:14.196291 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:14.196267 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:14.297013 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:14.296987 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 06 23:58:14.339763 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.339738 2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:14.382788 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.382728 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 06 23:58:14.390090 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.390039 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:14.396331 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.396310 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:58:14.397438 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.397423 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 06 23:58:14.406911 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.406894 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:58:14.923499 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.923309 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:58:14.959785 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.959757 2549 apiserver.go:52] "Watching apiserver" Jul 06 23:58:14.967395 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.966979 2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 23:58:14.967541 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.967517 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal","openshift-multus/network-metrics-daemon-w2rnb","openshift-network-operator/iptables-alerter-9x9hq","kube-system/global-pull-secret-syncer-wbbmh","kube-system/konnectivity-agent-zv66p","openshift-multus/multus-additional-cni-plugins-8nh8b","openshift-multus/multus-g5txc","openshift-network-diagnostics/network-check-target-9tpzd","openshift-ovn-kubernetes/ovnkube-node-2gqff","kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt","openshift-cluster-node-tuning-operator/tuned-f7cnz","openshift-dns/node-resolver-p99kk","openshift-image-registry/node-ca-4t2b6"] Jul 06 23:58:14.970363 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.970339 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g5txc" Jul 06 23:58:14.972625 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.972602 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:14.975326 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.973594 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 23:58:14.975326 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.973802 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 23:58:14.975326 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.974013 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 23:58:14.975326 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.974212 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5k8qx\"" Jul 06 23:58:14.975326 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.974437 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 23:58:14.975326 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.974970 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 23:58:14.975326 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.975215 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h2m7v\"" Jul 06 23:58:14.978257 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.976496 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:14.978257 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.977946 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:14.978257 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:14.978012 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:14.978735 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.978549 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 23:58:14.979614 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.979595 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:14.980472 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.980438 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:58:14.980680 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.980630 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h7s6t\"" Jul 06 23:58:14.981005 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.980984 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 23:58:14.981131 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.981114 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 23:58:14.983449 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.981948 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 23:58:14.983449 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.982222 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 23:58:14.983449 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.982455 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qvgdz\"" Jul 06 23:58:14.983449 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.982524 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:14.983449 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.983288 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 23:58:14.984940 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.984922 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:14.985164 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.985140 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 23:58:14.985363 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.985344 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 23:58:14.985638 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.985618 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qc5vm\"" Jul 06 23:58:14.987157 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.987138 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:14.988252 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.988231 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 23:58:14.988656 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.988634 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 23:58:14.988656 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.988655 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 23:58:14.988902 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.988883 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 23:58:14.989035 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.989016 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 23:58:14.989365 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.989322 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 23:58:14.990225 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.989655 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-njjdx\"" Jul 06 23:58:14.990225 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.989725 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:14.990225 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:14.989817 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:14.990225 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.989939 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 23:58:14.990225 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.990075 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-djh9n\"" Jul 06 23:58:14.990225 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.990145 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 23:58:14.990605 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.990223 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 23:58:14.992351 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.992330 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:14.992449 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:14.992398 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:14.993753 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.993674 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:58:14.995432 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.995407 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-cnibin\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:14.995541 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.995460 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-var-lib-cni-bin\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:14.997295 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.997264 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15ef6701-761f-4437-a24d-1f8cc1439acb-kubelet-config\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:14.997398 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.997332 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-run-netns\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:14.997461 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.997397 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.997403 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b09bd804-568b-4f7e-9621-e1bd704362d7-ovnkube-config\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.998425 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b09bd804-568b-4f7e-9621-e1bd704362d7-env-overrides\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.998472 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b09bd804-568b-4f7e-9621-e1bd704362d7-ovn-node-metrics-cert\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.998503 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/36f35e1e-7949-4839-918c-d20509e3bb21-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.998536 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-var-lib-kubelet\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.998675 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-os-release\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.998716 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhmxn\" (UniqueName: \"kubernetes.io/projected/084780e8-838d-4a25-b9c0-555ac609e13b-kube-api-access-hhmxn\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.998751 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef8a894-bebe-4f5e-a93a-4ad0f902e528-tmp-dir\") pod \"node-resolver-p99kk\" (UID: \"0ef8a894-bebe-4f5e-a93a-4ad0f902e528\") " pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.998780 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea-agent-certs\") pod \"konnectivity-agent-zv66p\" (UID: \"48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea\") " pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.998811 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-cni-bin\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.998959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-cni-netd\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999001 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b09bd804-568b-4f7e-9621-e1bd704362d7-ovnkube-script-lib\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999039 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x2rk\" (UniqueName: \"kubernetes.io/projected/36f35e1e-7949-4839-918c-d20509e3bb21-kube-api-access-9x2rk\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999145 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-var-lib-cni-multus\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:14.999195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999176 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-log-socket\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999205 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea-konnectivity-ca\") pod \"konnectivity-agent-zv66p\" (UID: \"48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea\") " pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999240 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-os-release\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999444 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/084780e8-838d-4a25-b9c0-555ac609e13b-cni-binary-copy\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999478 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-run-ovn\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999503 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-hostroot\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999542 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-multus-conf-dir\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999573 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-run-multus-certs\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999609 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-var-lib-openvswitch\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999637 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-run-openvswitch\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999757 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k42tr\" (UniqueName: \"kubernetes.io/projected/8897e8cd-fea4-4649-9504-1839b2d476bb-kube-api-access-k42tr\") pod \"iptables-alerter-9x9hq\" (UID: \"8897e8cd-fea4-4649-9504-1839b2d476bb\") " pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999791 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-multus-cni-dir\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999830 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-run-netns\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.000017 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:14.999959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-cnibin\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.000639 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.000072 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36f35e1e-7949-4839-918c-d20509e3bb21-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.000639 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.000131 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36f35e1e-7949-4839-918c-d20509e3bb21-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.000639 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.000580 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15ef6701-761f-4437-a24d-1f8cc1439acb-dbus\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:15.000794 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.000730 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.000794 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.000771 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-run-k8s-cni-cncf-io\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.000888 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.000803 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmr48\" (UniqueName: \"kubernetes.io/projected/0ef8a894-bebe-4f5e-a93a-4ad0f902e528-kube-api-access-dmr48\") pod \"node-resolver-p99kk\" (UID: \"0ef8a894-bebe-4f5e-a93a-4ad0f902e528\") " pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:15.000940 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.000873 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-kubelet\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.001282 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001016 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-slash\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.001282 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001083 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-node-log\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.001282 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001168 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.001282 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001175 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-55mnz\"" Jul 06 23:58:15.001282 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001215 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-system-cni-dir\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.001589 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001303 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-multus-socket-dir-parent\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.001589 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001382 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-etc-kubernetes\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.001589 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001462 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ef8a894-bebe-4f5e-a93a-4ad0f902e528-hosts-file\") pod \"node-resolver-p99kk\" (UID: \"0ef8a894-bebe-4f5e-a93a-4ad0f902e528\") " pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:15.001589 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001553 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.001791 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001598 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-system-cni-dir\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.001791 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001709 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 23:58:15.001898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001796 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 23:58:15.001898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001849 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/084780e8-838d-4a25-b9c0-555ac609e13b-multus-daemon-config\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.001898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001885 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:15.002048 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001918 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-etc-openvswitch\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.002048 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.001960 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-run-systemd\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.002048 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.002011 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8897e8cd-fea4-4649-9504-1839b2d476bb-iptables-alerter-script\") pod \"iptables-alerter-9x9hq\" (UID: \"8897e8cd-fea4-4649-9504-1839b2d476bb\") " pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:15.002048 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.002044 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-systemd-units\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.002332 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.002174 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f49fp\" (UniqueName: \"kubernetes.io/projected/b09bd804-568b-4f7e-9621-e1bd704362d7-kube-api-access-f49fp\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.002332 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.002321 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8897e8cd-fea4-4649-9504-1839b2d476bb-host-slash\") pod \"iptables-alerter-9x9hq\" (UID: \"8897e8cd-fea4-4649-9504-1839b2d476bb\") " pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:15.002955 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.002933 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.003218 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.002942 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 23:58:15.005474 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.005454 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lwwdn\"" Jul 06 23:58:15.005844 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.005828 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:58:15.006415 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.006395 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 23:58:15.024568 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.024545 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4p57" Jul 06 23:58:15.033708 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.033686 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4p57" Jul 06 23:58:15.084125 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.084099 2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 23:58:15.089697 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.089652 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" event={"ID":"c484925f8d284c178719cc07b93a5386","Type":"ContainerStarted","Data":"a254fb49f437c4189a2d002e3afd0f0ad583df053c8491836f5db97a13b4a6e4"} Jul 06 23:58:15.092448 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.092424 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" event={"ID":"5169869ecca979b9c375118c6ce6471c","Type":"ContainerStarted","Data":"1e3530dc3929ec791638e2e752d289e748d0dd3f279871f2376d18a1dab2ab3b"} Jul 06 23:58:15.102825 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.102803 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-run-openvswitch\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.102953 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.102835 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k42tr\" (UniqueName: \"kubernetes.io/projected/8897e8cd-fea4-4649-9504-1839b2d476bb-kube-api-access-k42tr\") pod \"iptables-alerter-9x9hq\" (UID: \"8897e8cd-fea4-4649-9504-1839b2d476bb\") " pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:15.102953 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.102857 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-modprobe-d\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.102953 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.102881 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-lib-modules\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.102953 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.102933 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-run-openvswitch\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.103165 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103019 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-multus-cni-dir\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.103165 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.102940 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-multus-cni-dir\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.103291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103134 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-run-netns\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.103291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103203 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-cnibin\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.103291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103244 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36f35e1e-7949-4839-918c-d20509e3bb21-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.103466 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103294 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-run-netns\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.103466 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103314 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36f35e1e-7949-4839-918c-d20509e3bb21-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.103466 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103353 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-host\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.103466 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103425 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-tuned\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.103466 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103454 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15ef6701-761f-4437-a24d-1f8cc1439acb-dbus\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:15.103723 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103480 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.103723 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103518 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-etc-selinux\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.103723 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103608 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-run-k8s-cni-cncf-io\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.103723 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103703 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-run-k8s-cni-cncf-io\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.103723 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103717 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-cnibin\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103704 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmr48\" (UniqueName: \"kubernetes.io/projected/0ef8a894-bebe-4f5e-a93a-4ad0f902e528-kube-api-access-dmr48\") pod \"node-resolver-p99kk\" (UID: \"0ef8a894-bebe-4f5e-a93a-4ad0f902e528\") " pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103759 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-kubelet\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103757 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103789 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-slash\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103814 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-kubelet\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103855 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-node-log\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103860 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15ef6701-761f-4437-a24d-1f8cc1439acb-dbus\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103883 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103911 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-node-log\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103913 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-sysconfig\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103924 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36f35e1e-7949-4839-918c-d20509e3bb21-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103949 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-sys\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.103986 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.103959 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104002 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-slash\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104032 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-system-cni-dir\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104089 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-system-cni-dir\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104111 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36f35e1e-7949-4839-918c-d20509e3bb21-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104157 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-multus-socket-dir-parent\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104281 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-multus-socket-dir-parent\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104332 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-etc-kubernetes\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104375 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ef8a894-bebe-4f5e-a93a-4ad0f902e528-hosts-file\") pod \"node-resolver-p99kk\" (UID: \"0ef8a894-bebe-4f5e-a93a-4ad0f902e528\") " pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104419 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104458 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-system-cni-dir\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104470 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104485 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ef8a894-bebe-4f5e-a93a-4ad0f902e528-hosts-file\") pod \"node-resolver-p99kk\" (UID: \"0ef8a894-bebe-4f5e-a93a-4ad0f902e528\") " pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104495 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8n4m\" (UniqueName: \"kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m\") pod \"network-check-target-9tpzd\" (UID: \"199c3a86-2700-4cab-ad48-aec9e41cf843\") " pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104421 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-etc-kubernetes\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104522 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-system-cni-dir\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104540 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-tmp\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.104689 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104570 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5mwh\" (UniqueName: \"kubernetes.io/projected/9cab9320-c9c9-438c-816c-ee36d5177062-kube-api-access-w5mwh\") pod \"node-ca-4t2b6\" (UID: \"9cab9320-c9c9-438c-816c-ee36d5177062\") " pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104595 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-sys-fs\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104621 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/084780e8-838d-4a25-b9c0-555ac609e13b-multus-daemon-config\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104647 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104682 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-etc-openvswitch\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104704 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-sysctl-conf\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104734 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cab9320-c9c9-438c-816c-ee36d5177062-host\") pod \"node-ca-4t2b6\" (UID: \"9cab9320-c9c9-438c-816c-ee36d5177062\") " pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104758 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9cab9320-c9c9-438c-816c-ee36d5177062-serviceca\") pod \"node-ca-4t2b6\" (UID: \"9cab9320-c9c9-438c-816c-ee36d5177062\") " pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104780 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-device-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104784 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-etc-openvswitch\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104808 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-run-systemd\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104843 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8897e8cd-fea4-4649-9504-1839b2d476bb-iptables-alerter-script\") pod \"iptables-alerter-9x9hq\" (UID: \"8897e8cd-fea4-4649-9504-1839b2d476bb\") " pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104869 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-systemd-units\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.104897 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104906 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f49fp\" (UniqueName: \"kubernetes.io/projected/b09bd804-568b-4f7e-9621-e1bd704362d7-kube-api-access-f49fp\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104931 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8897e8cd-fea4-4649-9504-1839b2d476bb-host-slash\") pod \"iptables-alerter-9x9hq\" (UID: \"8897e8cd-fea4-4649-9504-1839b2d476bb\") " pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.104960 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret podName:15ef6701-761f-4437-a24d-1f8cc1439acb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:15.604938481 +0000 UTC m=+3.035359225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret") pod "global-pull-secret-syncer-wbbmh" (UID: "15ef6701-761f-4437-a24d-1f8cc1439acb") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:15.105642 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104979 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8897e8cd-fea4-4649-9504-1839b2d476bb-host-slash\") pod \"iptables-alerter-9x9hq\" (UID: \"8897e8cd-fea4-4649-9504-1839b2d476bb\") " pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.104989 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-systemd\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105016 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105045 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-cnibin\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105216 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-run-systemd\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105299 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-cnibin\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105303 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-systemd-units\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105411 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-var-lib-cni-bin\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105444 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15ef6701-761f-4437-a24d-1f8cc1439acb-kubelet-config\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105471 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-run-netns\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105502 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b09bd804-568b-4f7e-9621-e1bd704362d7-ovnkube-config\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105527 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b09bd804-568b-4f7e-9621-e1bd704362d7-env-overrides\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105553 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b09bd804-568b-4f7e-9621-e1bd704362d7-ovn-node-metrics-cert\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105581 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/36f35e1e-7949-4839-918c-d20509e3bb21-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105632 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-var-lib-kubelet\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105639 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-run-netns\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105655 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/084780e8-838d-4a25-b9c0-555ac609e13b-multus-daemon-config\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.106522 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105657 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-os-release\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105692 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-kubernetes\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105718 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-var-lib-cni-bin\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105721 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-run\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105765 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhmxn\" (UniqueName: \"kubernetes.io/projected/084780e8-838d-4a25-b9c0-555ac609e13b-kube-api-access-hhmxn\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105791 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef8a894-bebe-4f5e-a93a-4ad0f902e528-tmp-dir\") pod \"node-resolver-p99kk\" (UID: \"0ef8a894-bebe-4f5e-a93a-4ad0f902e528\") " pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105820 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea-agent-certs\") pod \"konnectivity-agent-zv66p\" (UID: \"48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea\") " pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105845 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-cni-bin\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105870 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-cni-netd\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105895 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b09bd804-568b-4f7e-9621-e1bd704362d7-ovnkube-script-lib\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105922 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x2rk\" (UniqueName: \"kubernetes.io/projected/36f35e1e-7949-4839-918c-d20509e3bb21-kube-api-access-9x2rk\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105953 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-var-lib-kubelet\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.105985 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-var-lib-cni-multus\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106010 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-log-socket\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106037 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-sysctl-d\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106063 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106109 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-socket-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.107473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106141 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea-konnectivity-ca\") pod \"konnectivity-agent-zv66p\" (UID: \"48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea\") " pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106167 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-os-release\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106206 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/084780e8-838d-4a25-b9c0-555ac609e13b-cni-binary-copy\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106230 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-run-ovn\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106256 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqzbp\" (UniqueName: \"kubernetes.io/projected/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-kube-api-access-nqzbp\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106258 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8897e8cd-fea4-4649-9504-1839b2d476bb-iptables-alerter-script\") pod \"iptables-alerter-9x9hq\" (UID: \"8897e8cd-fea4-4649-9504-1839b2d476bb\") " pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106292 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6lwx\" (UniqueName: \"kubernetes.io/projected/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-kube-api-access-m6lwx\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106346 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15ef6701-761f-4437-a24d-1f8cc1439acb-kubelet-config\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106345 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b09bd804-568b-4f7e-9621-e1bd704362d7-ovnkube-config\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106377 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pp9h\" (UniqueName: \"kubernetes.io/projected/c8505f9f-9105-4006-91d2-5455cfe622a6-kube-api-access-7pp9h\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106415 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-var-lib-kubelet\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106410 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-registration-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106455 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-hostroot\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106484 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-multus-conf-dir\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106559 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-run-multus-certs\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106587 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-var-lib-openvswitch\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106773 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b09bd804-568b-4f7e-9621-e1bd704362d7-env-overrides\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.108245 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106863 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36f35e1e-7949-4839-918c-d20509e3bb21-os-release\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106891 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef8a894-bebe-4f5e-a93a-4ad0f902e528-tmp-dir\") pod \"node-resolver-p99kk\" (UID: \"0ef8a894-bebe-4f5e-a93a-4ad0f902e528\") " pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106968 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-var-lib-openvswitch\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.106999 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.107349 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-multus-conf-dir\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.107409 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-run-multus-certs\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.107451 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-hostroot\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.107532 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea-konnectivity-ca\") pod \"konnectivity-agent-zv66p\" (UID: \"48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea\") " pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.107603 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-os-release\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.107683 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-cni-bin\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.107719 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-host-cni-netd\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.107896 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/36f35e1e-7949-4839-918c-d20509e3bb21-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.107966 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-run-ovn\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.107999 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/084780e8-838d-4a25-b9c0-555ac609e13b-cni-binary-copy\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.108010 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/084780e8-838d-4a25-b9c0-555ac609e13b-host-var-lib-cni-multus\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.108055 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b09bd804-568b-4f7e-9621-e1bd704362d7-log-socket\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.109169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.108233 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b09bd804-568b-4f7e-9621-e1bd704362d7-ovnkube-script-lib\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.110770 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.110743 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b09bd804-568b-4f7e-9621-e1bd704362d7-ovn-node-metrics-cert\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.111387 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.111363 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea-agent-certs\") pod \"konnectivity-agent-zv66p\" (UID: \"48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea\") " pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:15.114905 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.114874 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k42tr\" (UniqueName: \"kubernetes.io/projected/8897e8cd-fea4-4649-9504-1839b2d476bb-kube-api-access-k42tr\") pod \"iptables-alerter-9x9hq\" (UID: \"8897e8cd-fea4-4649-9504-1839b2d476bb\") " pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:15.115879 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.115855 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmr48\" (UniqueName: \"kubernetes.io/projected/0ef8a894-bebe-4f5e-a93a-4ad0f902e528-kube-api-access-dmr48\") pod \"node-resolver-p99kk\" (UID: \"0ef8a894-bebe-4f5e-a93a-4ad0f902e528\") " pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:15.119195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.119166 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f49fp\" (UniqueName: \"kubernetes.io/projected/b09bd804-568b-4f7e-9621-e1bd704362d7-kube-api-access-f49fp\") pod \"ovnkube-node-2gqff\" (UID: \"b09bd804-568b-4f7e-9621-e1bd704362d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.119195 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.119183 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhmxn\" (UniqueName: \"kubernetes.io/projected/084780e8-838d-4a25-b9c0-555ac609e13b-kube-api-access-hhmxn\") pod \"multus-g5txc\" (UID: \"084780e8-838d-4a25-b9c0-555ac609e13b\") " pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.122202 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.122161 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x2rk\" (UniqueName: \"kubernetes.io/projected/36f35e1e-7949-4839-918c-d20509e3bb21-kube-api-access-9x2rk\") pod \"multus-additional-cni-plugins-8nh8b\" (UID: \"36f35e1e-7949-4839-918c-d20509e3bb21\") " pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.207399 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207362 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-host\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207574 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207406 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-tuned\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207574 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207444 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-etc-selinux\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.207574 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207478 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-sysconfig\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207574 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207501 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-sys\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207574 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207532 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n4m\" (UniqueName: \"kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m\") pod \"network-check-target-9tpzd\" (UID: \"199c3a86-2700-4cab-ad48-aec9e41cf843\") " pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:15.207574 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207558 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-tmp\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207584 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5mwh\" (UniqueName: \"kubernetes.io/projected/9cab9320-c9c9-438c-816c-ee36d5177062-kube-api-access-w5mwh\") pod \"node-ca-4t2b6\" (UID: \"9cab9320-c9c9-438c-816c-ee36d5177062\") " pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207611 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-sys-fs\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207651 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-sysctl-conf\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207674 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cab9320-c9c9-438c-816c-ee36d5177062-host\") pod \"node-ca-4t2b6\" (UID: \"9cab9320-c9c9-438c-816c-ee36d5177062\") " pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207699 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9cab9320-c9c9-438c-816c-ee36d5177062-serviceca\") pod \"node-ca-4t2b6\" (UID: \"9cab9320-c9c9-438c-816c-ee36d5177062\") " pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207724 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-device-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207744 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-host\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207752 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-systemd\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207775 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207807 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-kubernetes\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207829 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-run\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207860 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-var-lib-kubelet\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.207895 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207884 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-sysctl-d\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207919 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207946 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-socket-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.207977 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqzbp\" (UniqueName: \"kubernetes.io/projected/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-kube-api-access-nqzbp\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208004 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6lwx\" (UniqueName: \"kubernetes.io/projected/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-kube-api-access-m6lwx\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208031 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pp9h\" (UniqueName: \"kubernetes.io/projected/c8505f9f-9105-4006-91d2-5455cfe622a6-kube-api-access-7pp9h\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208056 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-registration-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208132 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-registration-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208129 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-systemd\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208161 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-modprobe-d\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208198 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-lib-modules\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.208236 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.208317 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs podName:c8505f9f-9105-4006-91d2-5455cfe622a6 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:15.708284424 +0000 UTC m=+3.138705165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs") pod "network-metrics-daemon-w2rnb" (UID: "c8505f9f-9105-4006-91d2-5455cfe622a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208372 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-lib-modules\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208441 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-sys\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208440 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-kubernetes\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208490 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cab9320-c9c9-438c-816c-ee36d5177062-host\") pod \"node-ca-4t2b6\" (UID: \"9cab9320-c9c9-438c-816c-ee36d5177062\") " pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:15.208567 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208542 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-run\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.209506 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208591 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-var-lib-kubelet\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.209506 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208712 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-sysctl-d\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.209506 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208772 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.209506 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208877 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9cab9320-c9c9-438c-816c-ee36d5177062-serviceca\") pod \"node-ca-4t2b6\" (UID: \"9cab9320-c9c9-438c-816c-ee36d5177062\") " pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:15.209506 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208884 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-socket-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.209506 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.208952 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-device-dir\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.209506 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.209045 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-modprobe-d\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.209506 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.209369 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-etc-selinux\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.209506 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.209470 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-sys-fs\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.209506 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.209496 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-sysctl-conf\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.210056 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.209526 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-sysconfig\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.211654 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.211614 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-etc-tuned\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.211777 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.211689 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-tmp\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.218551 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.218532 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:15.218666 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.218556 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:15.218666 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.218572 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s8n4m for pod openshift-network-diagnostics/network-check-target-9tpzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:15.218776 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.218677 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m podName:199c3a86-2700-4cab-ad48-aec9e41cf843 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:15.718659799 +0000 UTC m=+3.149080555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s8n4m" (UniqueName: "kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m") pod "network-check-target-9tpzd" (UID: "199c3a86-2700-4cab-ad48-aec9e41cf843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:15.222075 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.222048 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pp9h\" (UniqueName: \"kubernetes.io/projected/c8505f9f-9105-4006-91d2-5455cfe622a6-kube-api-access-7pp9h\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:15.222698 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.222667 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6lwx\" (UniqueName: \"kubernetes.io/projected/e7cf90a7-c1c5-4d05-a697-1c89f07a2806-kube-api-access-m6lwx\") pod \"tuned-f7cnz\" (UID: \"e7cf90a7-c1c5-4d05-a697-1c89f07a2806\") " pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.223488 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.223465 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqzbp\" (UniqueName: \"kubernetes.io/projected/f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd-kube-api-access-nqzbp\") pod \"aws-ebs-csi-driver-node-8nfmt\" (UID: \"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.224082 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.224050 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5mwh\" (UniqueName: \"kubernetes.io/projected/9cab9320-c9c9-438c-816c-ee36d5177062-kube-api-access-w5mwh\") pod \"node-ca-4t2b6\" (UID: \"9cab9320-c9c9-438c-816c-ee36d5177062\") " pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:15.288700 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.288659 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g5txc" Jul 06 23:58:15.301984 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.301955 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p99kk" Jul 06 23:58:15.315215 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.315173 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9x9hq" Jul 06 23:58:15.324287 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.324266 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:15.340185 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.340163 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" Jul 06 23:58:15.347216 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.347170 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:15.357156 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.357130 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4t2b6" Jul 06 23:58:15.365130 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.365078 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" Jul 06 23:58:15.372077 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.372055 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" Jul 06 23:58:15.611991 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.611904 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:15.612140 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.612050 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:15.612140 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.612113 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret podName:15ef6701-761f-4437-a24d-1f8cc1439acb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:16.612098634 +0000 UTC m=+4.042519374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret") pod "global-pull-secret-syncer-wbbmh" (UID: "15ef6701-761f-4437-a24d-1f8cc1439acb") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:15.712994 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.712960 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:15.713167 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.713085 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:15.713167 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.713148 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs podName:c8505f9f-9105-4006-91d2-5455cfe622a6 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:16.713134509 +0000 UTC m=+4.143555249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs") pod "network-metrics-daemon-w2rnb" (UID: "c8505f9f-9105-4006-91d2-5455cfe622a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:15.814151 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:15.814113 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n4m\" (UniqueName: \"kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m\") pod \"network-check-target-9tpzd\" (UID: \"199c3a86-2700-4cab-ad48-aec9e41cf843\") " pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:15.814348 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.814275 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:15.814348 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.814296 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:15.814348 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.814311 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s8n4m for pod openshift-network-diagnostics/network-check-target-9tpzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:15.814516 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:15.814373 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m podName:199c3a86-2700-4cab-ad48-aec9e41cf843 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:16.814358424 +0000 UTC m=+4.244779169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8n4m" (UniqueName: "kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m") pod "network-check-target-9tpzd" (UID: "199c3a86-2700-4cab-ad48-aec9e41cf843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:16.036972 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:16.036937 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:53:15 +0000 UTC" deadline="2028-04-21 12:29:38.610187454 +0000 UTC" Jul 06 23:58:16.036972 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:16.036967 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15708h31m22.573223781s" Jul 06 23:58:16.375593 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:16.375554 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef8a894_bebe_4f5e_a93a_4ad0f902e528.slice/crio-f5377690f65a68dced2d99fc61fdaf1bdc6f65e3828008fa13d6599eaccde3b0 WatchSource:0}: Error finding container f5377690f65a68dced2d99fc61fdaf1bdc6f65e3828008fa13d6599eaccde3b0: Status 404 returned error can't find the container with id f5377690f65a68dced2d99fc61fdaf1bdc6f65e3828008fa13d6599eaccde3b0 Jul 06 23:58:16.377806 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:16.377555 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36f35e1e_7949_4839_918c_d20509e3bb21.slice/crio-2d2daf8fb20f4ff37bcf1c14f498b238c50c60fa54225ef1fade7ed8bea25066 WatchSource:0}: Error finding container 2d2daf8fb20f4ff37bcf1c14f498b238c50c60fa54225ef1fade7ed8bea25066: Status 404 returned error can't find the container with id 2d2daf8fb20f4ff37bcf1c14f498b238c50c60fa54225ef1fade7ed8bea25066 Jul 06 23:58:16.378553 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:16.378477 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48eb1ac7_d2ec_401c_bd8a_fcf5fa8c11ea.slice/crio-9fea44e6b588af3353e4e4ef4f2e23e60ea485354ec622a25989ab0b64649502 WatchSource:0}: Error finding container 9fea44e6b588af3353e4e4ef4f2e23e60ea485354ec622a25989ab0b64649502: Status 404 returned error can't find the container with id 9fea44e6b588af3353e4e4ef4f2e23e60ea485354ec622a25989ab0b64649502 Jul 06 23:58:16.381927 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:16.381902 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09bd804_568b_4f7e_9621_e1bd704362d7.slice/crio-5f1fc2e92149e74b3bf3e1dc4bd2afff7822c53884b7987db999f0aab0a55a8e WatchSource:0}: Error finding container 5f1fc2e92149e74b3bf3e1dc4bd2afff7822c53884b7987db999f0aab0a55a8e: Status 404 returned error can't find the container with id 5f1fc2e92149e74b3bf3e1dc4bd2afff7822c53884b7987db999f0aab0a55a8e Jul 06 23:58:16.382781 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:16.382758 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cf90a7_c1c5_4d05_a697_1c89f07a2806.slice/crio-54d1943761363f0df48378f36368d48369f5aa84c42c40d09a8948cf4779823a WatchSource:0}: Error finding container 54d1943761363f0df48378f36368d48369f5aa84c42c40d09a8948cf4779823a: Status 404 returned error can't find the container with id 54d1943761363f0df48378f36368d48369f5aa84c42c40d09a8948cf4779823a Jul 06 23:58:16.384379 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:16.383906 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cab9320_c9c9_438c_816c_ee36d5177062.slice/crio-6a559898430e3c8220767125ab92bcdaa7a4c368eb3adcf07c8e04846b7307b6 WatchSource:0}: Error finding container 6a559898430e3c8220767125ab92bcdaa7a4c368eb3adcf07c8e04846b7307b6: Status 404 returned error can't find the container with id 6a559898430e3c8220767125ab92bcdaa7a4c368eb3adcf07c8e04846b7307b6 Jul 06 23:58:16.384770 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:16.384721 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8897e8cd_fea4_4649_9504_1839b2d476bb.slice/crio-7b86196f37406b5ea1c092727c0ab8389a9504201f1aac6c8e21ee61d2747399 WatchSource:0}: Error finding container 7b86196f37406b5ea1c092727c0ab8389a9504201f1aac6c8e21ee61d2747399: Status 404 returned error can't find the container with id 7b86196f37406b5ea1c092727c0ab8389a9504201f1aac6c8e21ee61d2747399 Jul 06 23:58:16.386039 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:16.385920 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b8dd1c_d9fa_4593_a58d_32dbd97b6dfd.slice/crio-e6e88e75005642dab2d6f4c9aa1847e4ff06d285b653aabe253e6c8ff813340f WatchSource:0}: Error finding container e6e88e75005642dab2d6f4c9aa1847e4ff06d285b653aabe253e6c8ff813340f: Status 404 returned error can't find the container with id e6e88e75005642dab2d6f4c9aa1847e4ff06d285b653aabe253e6c8ff813340f Jul 06 23:58:16.620881 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:16.620559 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:16.620881 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:16.620782 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:16.621115 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:16.620943 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret podName:15ef6701-761f-4437-a24d-1f8cc1439acb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:18.620920823 +0000 UTC m=+6.051341582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret") pod "global-pull-secret-syncer-wbbmh" (UID: "15ef6701-761f-4437-a24d-1f8cc1439acb") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:16.721958 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:16.721932 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:16.722065 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:16.722051 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:16.722105 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:16.722101 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs podName:c8505f9f-9105-4006-91d2-5455cfe622a6 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:18.722087914 +0000 UTC m=+6.152508655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs") pod "network-metrics-daemon-w2rnb" (UID: "c8505f9f-9105-4006-91d2-5455cfe622a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:16.822934 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:16.822878 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n4m\" (UniqueName: \"kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m\") pod \"network-check-target-9tpzd\" (UID: \"199c3a86-2700-4cab-ad48-aec9e41cf843\") " pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:16.823104 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:16.823030 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:16.823104 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:16.823057 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:16.823104 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:16.823072 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s8n4m for pod openshift-network-diagnostics/network-check-target-9tpzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:16.823310 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:16.823141 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m podName:199c3a86-2700-4cab-ad48-aec9e41cf843 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:18.823120561 +0000 UTC m=+6.253541314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8n4m" (UniqueName: "kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m") pod "network-check-target-9tpzd" (UID: "199c3a86-2700-4cab-ad48-aec9e41cf843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:17.038028 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.037959 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:53:15 +0000 UTC" deadline="2028-03-31 11:32:01.095200542 +0000 UTC" Jul 06 23:58:17.038028 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.038027 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15203h33m44.057178195s" Jul 06 23:58:17.088133 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.088103 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:17.088317 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:17.088228 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:17.088992 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.088673 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:17.088992 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:17.088795 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:17.088992 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.088860 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:17.088992 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:17.088931 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:17.122083 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.122049 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerStarted","Data":"5f1fc2e92149e74b3bf3e1dc4bd2afff7822c53884b7987db999f0aab0a55a8e"} Jul 06 23:58:17.129783 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.129689 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" event={"ID":"36f35e1e-7949-4839-918c-d20509e3bb21","Type":"ContainerStarted","Data":"2d2daf8fb20f4ff37bcf1c14f498b238c50c60fa54225ef1fade7ed8bea25066"} Jul 06 23:58:17.135326 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.134676 2549 generic.go:356] "Generic (PLEG): container finished" podID="5169869ecca979b9c375118c6ce6471c" containerID="2dd61798de249644605ae9a2d5d7c52cccdbf19a2cfba8d41a91362f85c269b2" exitCode=0 Jul 06 23:58:17.135326 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.134772 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" event={"ID":"5169869ecca979b9c375118c6ce6471c","Type":"ContainerDied","Data":"2dd61798de249644605ae9a2d5d7c52cccdbf19a2cfba8d41a91362f85c269b2"} Jul 06 23:58:17.144938 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.144875 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g5txc" event={"ID":"084780e8-838d-4a25-b9c0-555ac609e13b","Type":"ContainerStarted","Data":"a808f00c15b59e5ea522f764087e16fd29ccb5ebae5ccb0ba4740d7b439960cb"} Jul 06 23:58:17.148898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.148877 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4t2b6" event={"ID":"9cab9320-c9c9-438c-816c-ee36d5177062","Type":"ContainerStarted","Data":"6a559898430e3c8220767125ab92bcdaa7a4c368eb3adcf07c8e04846b7307b6"} Jul 06 23:58:17.160704 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.159559 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" event={"ID":"e7cf90a7-c1c5-4d05-a697-1c89f07a2806","Type":"ContainerStarted","Data":"54d1943761363f0df48378f36368d48369f5aa84c42c40d09a8948cf4779823a"} Jul 06 23:58:17.179602 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.179572 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zv66p" event={"ID":"48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea","Type":"ContainerStarted","Data":"9fea44e6b588af3353e4e4ef4f2e23e60ea485354ec622a25989ab0b64649502"} Jul 06 23:58:17.189129 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.189058 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p99kk" event={"ID":"0ef8a894-bebe-4f5e-a93a-4ad0f902e528","Type":"ContainerStarted","Data":"f5377690f65a68dced2d99fc61fdaf1bdc6f65e3828008fa13d6599eaccde3b0"} Jul 06 23:58:17.202052 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.201637 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" event={"ID":"c484925f8d284c178719cc07b93a5386","Type":"ContainerStarted","Data":"f8da0479c7ba041d46088726e13e2de2c430ca63b8b0dd3f11d82a9ff6ea2689"} Jul 06 23:58:17.214384 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.214356 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" event={"ID":"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd","Type":"ContainerStarted","Data":"e6e88e75005642dab2d6f4c9aa1847e4ff06d285b653aabe253e6c8ff813340f"} Jul 06 23:58:17.222290 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.222233 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" podStartSLOduration=3.222213115 podStartE2EDuration="3.222213115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:17.221481445 +0000 UTC m=+4.651902211" watchObservedRunningTime="2026-07-06 23:58:17.222213115 +0000 UTC m=+4.652633882" Jul 06 23:58:17.233341 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:17.233313 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9x9hq" event={"ID":"8897e8cd-fea4-4649-9504-1839b2d476bb","Type":"ContainerStarted","Data":"7b86196f37406b5ea1c092727c0ab8389a9504201f1aac6c8e21ee61d2747399"} Jul 06 23:58:18.264345 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:18.264286 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" event={"ID":"5169869ecca979b9c375118c6ce6471c","Type":"ContainerStarted","Data":"a3e376969505f35951d1ddad676785c028e0ae7e2137476e2e682b37efcc3db1"} Jul 06 23:58:18.294239 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:18.290983 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" podStartSLOduration=4.290955 podStartE2EDuration="4.290955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:18.279550202 +0000 UTC m=+5.709970965" watchObservedRunningTime="2026-07-06 23:58:18.290955 +0000 UTC m=+5.721375761" Jul 06 23:58:18.640152 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:18.640072 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:18.640328 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:18.640252 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:18.640328 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:18.640315 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret podName:15ef6701-761f-4437-a24d-1f8cc1439acb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:22.640295954 +0000 UTC m=+10.070716696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret") pod "global-pull-secret-syncer-wbbmh" (UID: "15ef6701-761f-4437-a24d-1f8cc1439acb") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:18.741254 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:18.741195 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:18.741415 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:18.741361 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:18.741851 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:18.741486 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs podName:c8505f9f-9105-4006-91d2-5455cfe622a6 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:22.741415192 +0000 UTC m=+10.171835934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs") pod "network-metrics-daemon-w2rnb" (UID: "c8505f9f-9105-4006-91d2-5455cfe622a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:18.843003 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:18.842307 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n4m\" (UniqueName: \"kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m\") pod \"network-check-target-9tpzd\" (UID: \"199c3a86-2700-4cab-ad48-aec9e41cf843\") " pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:18.843003 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:18.842533 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:18.843003 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:18.842553 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:18.843003 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:18.842567 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s8n4m for pod openshift-network-diagnostics/network-check-target-9tpzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:18.843003 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:18.842628 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m podName:199c3a86-2700-4cab-ad48-aec9e41cf843 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:22.842607938 +0000 UTC m=+10.273028683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8n4m" (UniqueName: "kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m") pod "network-check-target-9tpzd" (UID: "199c3a86-2700-4cab-ad48-aec9e41cf843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:19.088443 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:19.088410 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:19.088633 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:19.088533 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:19.088936 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:19.088918 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:19.089030 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:19.089008 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:19.089093 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:19.089082 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:19.089180 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:19.089164 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:21.087456 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:21.086285 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:21.087456 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:21.086413 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:21.087456 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:21.086636 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:21.087456 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:21.086740 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:21.087456 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:21.086763 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:21.087456 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:21.086844 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:22.674287 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:22.673559 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:22.674287 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:22.673801 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:22.674287 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:22.673878 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret podName:15ef6701-761f-4437-a24d-1f8cc1439acb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:30.6738561 +0000 UTC m=+18.104276859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret") pod "global-pull-secret-syncer-wbbmh" (UID: "15ef6701-761f-4437-a24d-1f8cc1439acb") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:22.774611 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:22.774568 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:22.774758 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:22.774717 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:22.774811 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:22.774799 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs podName:c8505f9f-9105-4006-91d2-5455cfe622a6 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:30.774778242 +0000 UTC m=+18.205198993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs") pod "network-metrics-daemon-w2rnb" (UID: "c8505f9f-9105-4006-91d2-5455cfe622a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:22.875682 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:22.875635 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n4m\" (UniqueName: \"kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m\") pod \"network-check-target-9tpzd\" (UID: \"199c3a86-2700-4cab-ad48-aec9e41cf843\") " pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:22.875872 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:22.875846 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:22.875934 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:22.875872 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:22.875934 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:22.875887 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s8n4m for pod openshift-network-diagnostics/network-check-target-9tpzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:22.876041 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:22.875952 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m podName:199c3a86-2700-4cab-ad48-aec9e41cf843 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:30.875932866 +0000 UTC m=+18.306353607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8n4m" (UniqueName: "kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m") pod "network-check-target-9tpzd" (UID: "199c3a86-2700-4cab-ad48-aec9e41cf843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:23.089453 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:23.089369 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:23.089663 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:23.089475 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:23.089663 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:23.089369 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:23.089663 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:23.089578 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:23.089824 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:23.089715 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:23.089824 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:23.089802 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:25.089754 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:25.089404 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:25.089754 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:25.089509 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:25.089754 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:25.089517 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:25.089754 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:25.089586 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:25.089754 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:25.089622 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:25.089754 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:25.089683 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:27.085788 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:27.085713 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:27.086212 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:27.085719 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:27.086212 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:27.085832 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:27.086212 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:27.085719 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:27.086212 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:27.085930 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:27.086212 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:27.085989 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:29.090425 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:29.090354 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:29.090816 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:29.090462 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:29.090816 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:29.090469 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:29.090816 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:29.090474 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:29.090816 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:29.090583 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:29.090816 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:29.090652 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:30.738108 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:30.738077 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:30.738555 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:30.738211 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:30.738555 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:30.738281 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret podName:15ef6701-761f-4437-a24d-1f8cc1439acb nodeName:}" failed. No retries permitted until 2026-07-06 23:58:46.738268157 +0000 UTC m=+34.168688896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret") pod "global-pull-secret-syncer-wbbmh" (UID: "15ef6701-761f-4437-a24d-1f8cc1439acb") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:30.838633 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:30.838604 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:30.838791 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:30.838753 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:30.838851 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:30.838825 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs podName:c8505f9f-9105-4006-91d2-5455cfe622a6 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:46.838809145 +0000 UTC m=+34.269229900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs") pod "network-metrics-daemon-w2rnb" (UID: "c8505f9f-9105-4006-91d2-5455cfe622a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:30.939381 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:30.939349 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n4m\" (UniqueName: \"kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m\") pod \"network-check-target-9tpzd\" (UID: \"199c3a86-2700-4cab-ad48-aec9e41cf843\") " pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:30.939559 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:30.939493 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:30.939559 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:30.939512 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:30.939559 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:30.939522 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s8n4m for pod openshift-network-diagnostics/network-check-target-9tpzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:30.939671 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:30.939581 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m podName:199c3a86-2700-4cab-ad48-aec9e41cf843 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:46.939563107 +0000 UTC m=+34.369983853 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8n4m" (UniqueName: "kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m") pod "network-check-target-9tpzd" (UID: "199c3a86-2700-4cab-ad48-aec9e41cf843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:31.086039 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:31.085961 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:31.086179 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:31.085969 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:31.086179 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:31.086083 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:31.086179 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:31.086088 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:31.086179 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:31.086156 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:31.086364 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:31.086284 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:33.087296 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:33.087264 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:33.087744 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:33.087413 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:33.087744 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:33.087470 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:33.087744 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:33.087610 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:33.088030 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:33.087983 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:33.088556 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:33.088060 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:35.092339 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.090988 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:35.092339 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:35.091318 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:35.092339 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.091485 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:35.092339 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:35.091597 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:35.092339 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.091162 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:35.092339 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:35.091688 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:35.306043 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.305297 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" event={"ID":"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd","Type":"ContainerStarted","Data":"03c33c2be2b16b3b7e1fdd6375399ff4fe2a8d90aafc3f4854dcf95478a5354a"} Jul 06 23:58:35.309091 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.309062 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerStarted","Data":"a6b6ce7c0bbb5a84ead66aadcdb284846b9ebd4d01c531f2557f33dc67171ea1"} Jul 06 23:58:35.309184 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.309144 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerStarted","Data":"2c41e7e945932ddeea018fa637ec2eed644bc88b42e1e685061774ba5f875ebd"} Jul 06 23:58:35.310802 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.310777 2549 generic.go:356] "Generic (PLEG): container finished" podID="36f35e1e-7949-4839-918c-d20509e3bb21" containerID="00faf6a0e38cc02eef7f83ceec0c3561b74a1de17ba6b4b5c5b01baad923519e" exitCode=0 Jul 06 23:58:35.310910 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.310861 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" event={"ID":"36f35e1e-7949-4839-918c-d20509e3bb21","Type":"ContainerDied","Data":"00faf6a0e38cc02eef7f83ceec0c3561b74a1de17ba6b4b5c5b01baad923519e"} Jul 06 23:58:35.313077 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.313009 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g5txc" event={"ID":"084780e8-838d-4a25-b9c0-555ac609e13b","Type":"ContainerStarted","Data":"2aa43af19f3c662082667da91479a3f53e97a0491c81dc7c780eae39b0b4cc79"} Jul 06 23:58:35.315071 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.314922 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4t2b6" event={"ID":"9cab9320-c9c9-438c-816c-ee36d5177062","Type":"ContainerStarted","Data":"aa875d288384988e15a61ddeec5c3a5f3746f74bd4d48dc86d7ad3063f66d212"} Jul 06 23:58:35.316932 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.316898 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" event={"ID":"e7cf90a7-c1c5-4d05-a697-1c89f07a2806","Type":"ContainerStarted","Data":"60299beb9a90eabfcff0de7329c1eda35f8df161d65093907c59ddf70d1c3df9"} Jul 06 23:58:35.318403 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.318377 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zv66p" event={"ID":"48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea","Type":"ContainerStarted","Data":"75e43b16fbacfafaef498b99cbc0880c25224e4f8b13b7377d99dc122c5a9588"} Jul 06 23:58:35.320345 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.320320 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p99kk" event={"ID":"0ef8a894-bebe-4f5e-a93a-4ad0f902e528","Type":"ContainerStarted","Data":"90bc3013116b4e5684acbb66ba5cc7e8d041789d9d6481886f4a62f26e16cc82"} Jul 06 23:58:35.350240 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.350189 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g5txc" podStartSLOduration=3.741850211 podStartE2EDuration="22.350175038s" totalImagesPullingTime="18.608324827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:35.349848467 +0000 UTC m=+22.780269228" watchObservedRunningTime="2026-07-06 23:58:35.350175038 +0000 UTC m=+22.780595799" Jul 06 23:58:35.369312 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.369275 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p99kk" podStartSLOduration=3.792248502 podStartE2EDuration="22.369263658s" totalImagesPullingTime="18.577015156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:35.368819488 +0000 UTC m=+22.799240250" watchObservedRunningTime="2026-07-06 23:58:35.369263658 +0000 UTC m=+22.799684421" Jul 06 23:58:35.387444 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.387399 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zv66p" podStartSLOduration=11.90628995 podStartE2EDuration="22.387387896s" totalImagesPullingTime="10.481097946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:35.387323846 +0000 UTC m=+22.817744608" watchObservedRunningTime="2026-07-06 23:58:35.387387896 +0000 UTC m=+22.817808656" Jul 06 23:58:35.402936 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.402903 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4t2b6" podStartSLOduration=3.835062014 podStartE2EDuration="22.402891389s" totalImagesPullingTime="18.567829375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:35.402584108 +0000 UTC m=+22.833004866" watchObservedRunningTime="2026-07-06 23:58:35.402891389 +0000 UTC m=+22.833312150" Jul 06 23:58:35.425093 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:35.425059 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f7cnz" podStartSLOduration=3.854800255 podStartE2EDuration="22.425047238s" totalImagesPullingTime="18.570246983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:35.424632568 +0000 UTC m=+22.855053331" watchObservedRunningTime="2026-07-06 23:58:35.425047238 +0000 UTC m=+22.855467998" Jul 06 23:58:36.326775 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:36.326696 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9x9hq" event={"ID":"8897e8cd-fea4-4649-9504-1839b2d476bb","Type":"ContainerStarted","Data":"056f8c0bef7f6f31fec43d817640a2167cb76b0d28b67d2d3f6774415af821f0"} Jul 06 23:58:36.329661 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:36.329640 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gqff_b09bd804-568b-4f7e-9621-e1bd704362d7/ovn-acl-logging/0.log" Jul 06 23:58:36.330000 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:36.329969 2549 generic.go:356] "Generic (PLEG): container finished" podID="b09bd804-568b-4f7e-9621-e1bd704362d7" containerID="a6b6ce7c0bbb5a84ead66aadcdb284846b9ebd4d01c531f2557f33dc67171ea1" exitCode=1 Jul 06 23:58:36.330110 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:36.330068 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerDied","Data":"a6b6ce7c0bbb5a84ead66aadcdb284846b9ebd4d01c531f2557f33dc67171ea1"} Jul 06 23:58:36.330176 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:36.330161 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerStarted","Data":"191c217c3f168c607fbeac2e6aca84aabcf4834b3834cf452e620355ac01882e"} Jul 06 23:58:36.330253 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:36.330216 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerStarted","Data":"e83d9c95d3cc9838556bb91a1723c25eb132e9e68ebadab67679c340bd8b75ab"} Jul 06 23:58:36.330318 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:36.330292 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerStarted","Data":"b193a6884a1d2f0954f2ef751c24d21e504b1c1517e1934fdca9e0789d4872f4"} Jul 06 23:58:36.330372 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:36.330340 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerStarted","Data":"5149f4709e96dafa7949ca2a20759a211a09237c68d9c43e8b11c0f34105ee83"} Jul 06 23:58:36.363820 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:36.363770 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9x9hq" podStartSLOduration=4.803163586 podStartE2EDuration="23.363755866s" totalImagesPullingTime="18.56059228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:36.363634646 +0000 UTC m=+23.794055408" watchObservedRunningTime="2026-07-06 23:58:36.363755866 +0000 UTC m=+23.794176628" Jul 06 23:58:36.755487 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:36.755460 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 23:58:37.060468 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:37.060358 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:58:36.755482143Z","UUID":"a922cf38-2c95-4e68-b510-5da1f22b6bf2","Handler":null,"Name":"","Endpoint":""} Jul 06 23:58:37.063060 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:37.063037 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 23:58:37.063189 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:37.063077 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 23:58:37.085188 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:37.085161 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:37.085338 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:37.085161 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:37.085338 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:37.085275 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:37.085338 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:37.085308 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:37.085500 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:37.085360 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:37.085500 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:37.085453 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:37.335054 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:37.334970 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" event={"ID":"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd","Type":"ContainerStarted","Data":"22ffb44cfaa8f681685a034c5cf9ee10034754629c4fd836e1522cb5c9efa66d"} Jul 06 23:58:38.339634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:38.339556 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" event={"ID":"f8b8dd1c-d9fa-4593-a58d-32dbd97b6dfd","Type":"ContainerStarted","Data":"2a3fb34db3d50d2fdcac2f17c3c2cf717bbc1a120e5d6019ba3811de7eb1f50e"} Jul 06 23:58:38.343082 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:38.343062 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gqff_b09bd804-568b-4f7e-9621-e1bd704362d7/ovn-acl-logging/0.log" Jul 06 23:58:38.343431 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:38.343407 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerStarted","Data":"97037a7a5229a0b8333bdb0df38cdd6d37114fc2e681f4aceca614bd4dde2cbc"} Jul 06 23:58:38.358412 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:38.358371 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nfmt" podStartSLOduration=4.04091026 podStartE2EDuration="25.358356336s" totalImagesPullingTime="21.317446076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:38.35760526 +0000 UTC m=+25.788026020" watchObservedRunningTime="2026-07-06 23:58:38.358356336 +0000 UTC m=+25.788777092" Jul 06 23:58:39.086345 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:39.086093 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:39.086521 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:39.086095 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:39.086521 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:39.086445 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:39.086521 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:39.086151 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:39.086683 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:39.086531 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:39.086683 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:39.086637 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:39.664368 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:39.664337 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:39.665107 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:39.665092 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:40.347970 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:40.347942 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:40.348457 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:40.348442 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zv66p" Jul 06 23:58:41.085764 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:41.085577 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:41.086556 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:41.085577 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:41.086556 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:41.085857 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:41.086556 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:41.085590 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:41.086556 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:41.085897 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:41.086556 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:41.085982 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:41.353061 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:41.352973 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gqff_b09bd804-568b-4f7e-9621-e1bd704362d7/ovn-acl-logging/0.log" Jul 06 23:58:41.353364 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:41.353341 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerStarted","Data":"a8f69ad420e7acb4b7693afaaab1797b7e1d2cb854857fc12da426958da6b5fe"} Jul 06 23:58:41.353578 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:41.353562 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:41.353794 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:41.353775 2549 scope.go:117] "RemoveContainer" containerID="a6b6ce7c0bbb5a84ead66aadcdb284846b9ebd4d01c531f2557f33dc67171ea1" Jul 06 23:58:41.355299 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:41.355276 2549 generic.go:356] "Generic (PLEG): container finished" podID="36f35e1e-7949-4839-918c-d20509e3bb21" containerID="109faa8e98dbc7005f0637bb71f38d8d5dc0f6d280af4df189afa69ba1200984" exitCode=0 Jul 06 23:58:41.355382 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:41.355344 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" event={"ID":"36f35e1e-7949-4839-918c-d20509e3bb21","Type":"ContainerDied","Data":"109faa8e98dbc7005f0637bb71f38d8d5dc0f6d280af4df189afa69ba1200984"} Jul 06 23:58:41.370999 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:41.370980 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:42.360671 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.360641 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gqff_b09bd804-568b-4f7e-9621-e1bd704362d7/ovn-acl-logging/0.log" Jul 06 23:58:42.361319 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.361014 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" event={"ID":"b09bd804-568b-4f7e-9621-e1bd704362d7","Type":"ContainerStarted","Data":"4a39b29566b8c413bb29d53e3c25e2bdc64a4bbc6ad0de78055b4e33494b7998"} Jul 06 23:58:42.361319 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.361243 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:42.361319 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.361320 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:42.375463 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.375448 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:58:42.388544 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.388496 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" podStartSLOduration=10.753099966 podStartE2EDuration="29.38847809s" totalImagesPullingTime="18.635378124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:42.386953044 +0000 UTC m=+29.817373816" watchObservedRunningTime="2026-07-06 23:58:42.38847809 +0000 UTC m=+29.818898850" Jul 06 23:58:42.482745 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.482719 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9tpzd"] Jul 06 23:58:42.482852 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.482842 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:42.482931 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:42.482913 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:42.485317 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.485297 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w2rnb"] Jul 06 23:58:42.485403 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.485392 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:42.485492 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:42.485475 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:42.497886 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.497863 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wbbmh"] Jul 06 23:58:42.497960 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:42.497947 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:42.498034 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:42.498017 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:43.365672 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:43.365639 2549 generic.go:356] "Generic (PLEG): container finished" podID="36f35e1e-7949-4839-918c-d20509e3bb21" containerID="09b45e1f1d186721694a85979ee2b2f709c317930de4b72b0d6da00299b97715" exitCode=0 Jul 06 23:58:43.366071 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:43.365728 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" event={"ID":"36f35e1e-7949-4839-918c-d20509e3bb21","Type":"ContainerDied","Data":"09b45e1f1d186721694a85979ee2b2f709c317930de4b72b0d6da00299b97715"} Jul 06 23:58:44.086073 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:44.086038 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:44.086247 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:44.086137 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:44.086247 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:44.086145 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:44.086247 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:44.086165 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:44.086372 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:44.086253 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:44.086372 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:44.086323 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:45.373159 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:45.372905 2549 generic.go:356] "Generic (PLEG): container finished" podID="36f35e1e-7949-4839-918c-d20509e3bb21" containerID="42fbfefaef39a707159287d4bc9f5c15b85f05b12485e3cd8ff80180241dba0e" exitCode=0 Jul 06 23:58:45.373546 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:45.372980 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" event={"ID":"36f35e1e-7949-4839-918c-d20509e3bb21","Type":"ContainerDied","Data":"42fbfefaef39a707159287d4bc9f5c15b85f05b12485e3cd8ff80180241dba0e"} Jul 06 23:58:46.086040 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:46.086009 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:46.086200 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:46.086009 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:46.086200 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.086110 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:46.086200 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:46.086009 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:46.086200 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.086185 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:46.086379 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.086358 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:46.758004 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:46.757970 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:46.758456 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.758090 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:46.758456 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.758145 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret podName:15ef6701-761f-4437-a24d-1f8cc1439acb nodeName:}" failed. No retries permitted until 2026-07-06 23:59:18.758127443 +0000 UTC m=+66.188548188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret") pod "global-pull-secret-syncer-wbbmh" (UID: "15ef6701-761f-4437-a24d-1f8cc1439acb") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:58:46.858951 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:46.858914 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:46.859106 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.859053 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:46.859156 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.859127 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs podName:c8505f9f-9105-4006-91d2-5455cfe622a6 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:18.859108183 +0000 UTC m=+66.289528923 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs") pod "network-metrics-daemon-w2rnb" (UID: "c8505f9f-9105-4006-91d2-5455cfe622a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:58:46.959761 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:46.959724 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n4m\" (UniqueName: \"kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m\") pod \"network-check-target-9tpzd\" (UID: \"199c3a86-2700-4cab-ad48-aec9e41cf843\") " pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:46.959916 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.959865 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:58:46.959916 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.959880 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:58:46.959916 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.959888 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s8n4m for pod openshift-network-diagnostics/network-check-target-9tpzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:46.960047 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:46.959939 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m podName:199c3a86-2700-4cab-ad48-aec9e41cf843 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:18.959920778 +0000 UTC m=+66.390341517 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8n4m" (UniqueName: "kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m") pod "network-check-target-9tpzd" (UID: "199c3a86-2700-4cab-ad48-aec9e41cf843") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:58:48.085435 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.085409 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:48.085890 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.085417 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:48.085890 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:48.085519 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wbbmh" podUID="15ef6701-761f-4437-a24d-1f8cc1439acb" Jul 06 23:58:48.085890 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.085539 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:48.085890 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:48.085648 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2rnb" podUID="c8505f9f-9105-4006-91d2-5455cfe622a6" Jul 06 23:58:48.085890 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:48.085726 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9tpzd" podUID="199c3a86-2700-4cab-ad48-aec9e41cf843" Jul 06 23:58:48.782019 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.781983 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeReady" Jul 06 23:58:48.782191 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.782121 2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 23:58:48.846196 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.846161 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-774947cc59-8b9t8"] Jul 06 23:58:48.851141 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.851123 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:48.855568 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.855547 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b"] Jul 06 23:58:48.856882 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.856865 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 23:58:48.856980 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.856892 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dzsxj\"" Jul 06 23:58:48.857633 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.857419 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 23:58:48.859338 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.859104 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-kjfjg"] Jul 06 23:58:48.860470 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.859585 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:48.862377 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.862359 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms"] Jul 06 23:58:48.862495 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.862475 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:48.865559 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.865541 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-fpxq2"] Jul 06 23:58:48.865677 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.865659 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:58:48.868722 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.868704 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:48.869754 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.869736 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm"] Jul 06 23:58:48.872810 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.872751 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:48.875552 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.874787 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm"] Jul 06 23:58:48.878053 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.877716 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.893986 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.894829 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.895070 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.895271 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.895442 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.895581 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.896430 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.898864 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.899032 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.899218 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-h4jss\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.899407 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.899585 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 23:58:48.901114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.899733 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hj6kt\"" Jul 06 23:58:48.901796 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.901481 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fxggh\"" Jul 06 23:58:48.901849 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.901810 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gnf4z\"" Jul 06 23:58:48.901849 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.901805 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 23:58:48.901849 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.901846 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 23:58:48.902005 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.901986 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mp8nm\"" Jul 06 23:58:48.902060 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.902005 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w"] Jul 06 23:58:48.902118 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.902080 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 23:58:48.902165 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.902145 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 23:58:48.902678 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.902477 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 23:58:48.902906 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.902847 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 23:58:48.903310 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.903291 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 23:58:48.903492 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.903477 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 23:58:48.908392 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.904723 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 23:58:48.908392 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.905895 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f986b9999-lj82p"] Jul 06 23:58:48.909974 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.909953 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 23:58:48.911554 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.910193 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w" Jul 06 23:58:48.911636 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.911602 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 23:58:48.913354 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.912928 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl"] Jul 06 23:58:48.913691 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.913669 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:48.913877 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.913857 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:58:48.913981 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.913890 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 23:58:48.914705 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.914690 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 23:58:48.915338 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.915321 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xvzkx\"" Jul 06 23:58:48.916054 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.916034 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6r5fx"] Jul 06 23:58:48.916201 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.916186 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:48.916648 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.916619 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 23:58:48.917302 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.917285 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 23:58:48.917631 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.917609 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 23:58:48.917760 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.917743 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 23:58:48.918019 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.918006 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sczk5\"" Jul 06 23:58:48.918694 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.918677 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 23:58:48.918812 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.918794 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 23:58:48.918879 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.918700 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 23:58:48.918935 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.918778 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 23:58:48.918984 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.918748 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 23:58:48.919270 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.919255 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 23:58:48.919442 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.919426 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6r5fx" Jul 06 23:58:48.919518 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.919284 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4lc7t"] Jul 06 23:58:48.922566 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.922551 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm"] Jul 06 23:58:48.922636 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.922628 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:48.925557 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.925522 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 23:58:48.925839 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.925822 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwk2d\"" Jul 06 23:58:48.926045 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.926030 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 23:58:48.926216 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.926205 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 23:58:48.928078 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.928061 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms"] Jul 06 23:58:48.929865 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.929847 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm"] Jul 06 23:58:48.932089 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.932072 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 23:58:48.932179 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.932107 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 23:58:48.932259 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.932243 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 23:58:48.932319 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.932304 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xc5bp\"" Jul 06 23:58:48.933014 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.932999 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-fpxq2"] Jul 06 23:58:48.933883 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.933864 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b"] Jul 06 23:58:48.934808 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.934793 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-kjfjg"] Jul 06 23:58:48.935647 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.935631 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f986b9999-lj82p"] Jul 06 23:58:48.952678 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.952660 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w"] Jul 06 23:58:48.965391 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.965025 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6r5fx"] Jul 06 23:58:48.967791 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.967764 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4lc7t"] Jul 06 23:58:48.967894 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.967828 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl"] Jul 06 23:58:48.972974 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.972953 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-774947cc59-8b9t8"] Jul 06 23:58:48.976159 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976138 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-tmp\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:48.976273 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976246 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-installation-pull-secrets\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:48.976346 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976297 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-bound-sa-token\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:48.976423 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976324 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9deeccd6-365c-43a1-b6d9-d564a21cde0a-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:48.976489 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976475 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8daf16ad-e5d6-40ff-bce7-c50d3519edac-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm\" (UID: \"8daf16ad-e5d6-40ff-bce7-c50d3519edac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" Jul 06 23:58:48.976540 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976504 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-image-registry-private-configuration\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:48.976585 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976561 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-trusted-ca\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:48.976659 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976639 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-snapshots\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:48.976753 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976675 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd9d5c53-ba09-4586-a544-88ea6352bb0c-trusted-ca\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:48.976753 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976698 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:48.976753 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976717 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd9d5c53-ba09-4586-a544-88ea6352bb0c-serving-cert\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:48.976753 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976737 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkvjz\" (UniqueName: \"kubernetes.io/projected/cd9d5c53-ba09-4586-a544-88ea6352bb0c-kube-api-access-nkvjz\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:48.976928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976776 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhxjj\" (UniqueName: \"kubernetes.io/projected/935eb03a-7e2a-4e71-b8fe-6d10043454b6-kube-api-access-qhxjj\") pod \"klusterlet-addon-workmgr-7d4bf7fb65-czdwm\" (UID: \"935eb03a-7e2a-4e71-b8fe-6d10043454b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:48.976928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976809 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-serving-cert\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:48.976928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976849 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-ca-trust-extracted\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:48.976928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976864 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-certificates\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:48.976928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976882 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpg6h\" (UniqueName: \"kubernetes.io/projected/8daf16ad-e5d6-40ff-bce7-c50d3519edac-kube-api-access-dpg6h\") pod \"managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm\" (UID: \"8daf16ad-e5d6-40ff-bce7-c50d3519edac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" Jul 06 23:58:48.976928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976905 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/935eb03a-7e2a-4e71-b8fe-6d10043454b6-tmp\") pod \"klusterlet-addon-workmgr-7d4bf7fb65-czdwm\" (UID: \"935eb03a-7e2a-4e71-b8fe-6d10043454b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:48.977145 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976940 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/935eb03a-7e2a-4e71-b8fe-6d10043454b6-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d4bf7fb65-czdwm\" (UID: \"935eb03a-7e2a-4e71-b8fe-6d10043454b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:48.977145 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976968 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc9w7\" (UniqueName: \"kubernetes.io/projected/9deeccd6-365c-43a1-b6d9-d564a21cde0a-kube-api-access-lc9w7\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:48.977145 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.976985 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pzwt\" (UniqueName: \"kubernetes.io/projected/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-kube-api-access-9pzwt\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:48.977145 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.977020 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:48.977145 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.977040 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:58:48.977145 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.977072 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:48.977145 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.977097 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fblsd\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-kube-api-access-fblsd\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:48.977145 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.977124 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:48.977465 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.977149 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd9d5c53-ba09-4586-a544-88ea6352bb0c-config\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:48.977465 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:48.977170 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgbn6\" (UniqueName: \"kubernetes.io/projected/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-kube-api-access-tgbn6\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:58:49.078132 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078064 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-ca-trust-extracted\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.078377 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078350 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-certificates\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.078483 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078387 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpg6h\" (UniqueName: \"kubernetes.io/projected/8daf16ad-e5d6-40ff-bce7-c50d3519edac-kube-api-access-dpg6h\") pod \"managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm\" (UID: \"8daf16ad-e5d6-40ff-bce7-c50d3519edac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" Jul 06 23:58:49.078483 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078413 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/935eb03a-7e2a-4e71-b8fe-6d10043454b6-tmp\") pod \"klusterlet-addon-workmgr-7d4bf7fb65-czdwm\" (UID: \"935eb03a-7e2a-4e71-b8fe-6d10043454b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:49.078483 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078462 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-ca-trust-extracted\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.078748 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078725 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/935eb03a-7e2a-4e71-b8fe-6d10043454b6-tmp\") pod \"klusterlet-addon-workmgr-7d4bf7fb65-czdwm\" (UID: \"935eb03a-7e2a-4e71-b8fe-6d10043454b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:49.078850 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078728 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/935eb03a-7e2a-4e71-b8fe-6d10043454b6-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d4bf7fb65-czdwm\" (UID: \"935eb03a-7e2a-4e71-b8fe-6d10043454b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:49.078850 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078806 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc9w7\" (UniqueName: \"kubernetes.io/projected/9deeccd6-365c-43a1-b6d9-d564a21cde0a-kube-api-access-lc9w7\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:49.078850 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078828 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pzwt\" (UniqueName: \"kubernetes.io/projected/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-kube-api-access-9pzwt\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.078981 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078857 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.078981 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.078945 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:58:49.079066 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079020 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-certificates\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.079066 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079024 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-tmp-dir\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.079146 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079083 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:49.079146 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079111 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-ca\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.079146 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.079127 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:58:49.079377 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.079212 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls podName:40e3706d-104f-4a61-96c9-f8e6ecb4e0b2 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:49.579195945 +0000 UTC m=+37.009616714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww9ms" (UID: "40e3706d-104f-4a61-96c9-f8e6ecb4e0b2") : secret "samples-operator-tls" not found Jul 06 23:58:49.079377 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.079215 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:58:49.079377 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079136 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-hub\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.079377 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.079369 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls podName:9deeccd6-365c-43a1-b6d9-d564a21cde0a nodeName:}" failed. No retries permitted until 2026-07-06 23:58:49.579353191 +0000 UTC m=+37.009773948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dtr5b" (UID: "9deeccd6-365c-43a1-b6d9-d564a21cde0a") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:58:49.079377 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079373 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-stats-auth\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.079643 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079414 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fblsd\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-kube-api-access-fblsd\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.079643 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079443 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.079643 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079473 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-default-certificate\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.079643 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079502 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.079643 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079572 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.079643 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079616 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd9d5c53-ba09-4586-a544-88ea6352bb0c-config\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:49.079898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079645 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgbn6\" (UniqueName: \"kubernetes.io/projected/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-kube-api-access-tgbn6\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:58:49.079898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079758 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-tmp\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.079898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079790 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e672cde-60c3-4c2e-a162-6487f41171bc-cert\") pod \"ingress-canary-6r5fx\" (UID: \"6e672cde-60c3-4c2e-a162-6487f41171bc\") " pod="openshift-ingress-canary/ingress-canary-6r5fx" Jul 06 23:58:49.079898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079817 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-installation-pull-secrets\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.079898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079841 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-config-volume\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.079898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079878 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/994bf19b-30bc-495b-9c52-31c1cf0ae962-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.079898 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079900 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sld2z\" (UniqueName: \"kubernetes.io/projected/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-kube-api-access-sld2z\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079930 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-bound-sa-token\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079950 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9deeccd6-365c-43a1-b6d9-d564a21cde0a-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079971 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8r28\" (UniqueName: \"kubernetes.io/projected/996107f2-75f4-4da3-a4d0-5938ed1fc92e-kube-api-access-h8r28\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.079995 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8daf16ad-e5d6-40ff-bce7-c50d3519edac-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm\" (UID: \"8daf16ad-e5d6-40ff-bce7-c50d3519edac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080020 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-image-registry-private-configuration\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080023 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080040 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080082 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-trusted-ca\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080106 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zl99\" (UniqueName: \"kubernetes.io/projected/7674237c-9c02-45a9-bcef-6418a5da70f3-kube-api-access-6zl99\") pod \"volume-data-source-validator-5d456fdbcd-4dc4w\" (UID: \"7674237c-9c02-45a9-bcef-6418a5da70f3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080127 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-snapshots\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080150 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd9d5c53-ba09-4586-a544-88ea6352bb0c-trusted-ca\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080161 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080174 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080189 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-tmp\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.080291 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080195 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdgcj\" (UniqueName: \"kubernetes.io/projected/994bf19b-30bc-495b-9c52-31c1cf0ae962-kube-api-access-vdgcj\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080241 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080316 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd9d5c53-ba09-4586-a544-88ea6352bb0c-config\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080374 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd9d5c53-ba09-4586-a544-88ea6352bb0c-serving-cert\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080402 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkvjz\" (UniqueName: \"kubernetes.io/projected/cd9d5c53-ba09-4586-a544-88ea6352bb0c-kube-api-access-nkvjz\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080427 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhxjj\" (UniqueName: \"kubernetes.io/projected/935eb03a-7e2a-4e71-b8fe-6d10043454b6-kube-api-access-qhxjj\") pod \"klusterlet-addon-workmgr-7d4bf7fb65-czdwm\" (UID: \"935eb03a-7e2a-4e71-b8fe-6d10043454b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080452 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080477 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-serving-cert\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080508 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgsqp\" (UniqueName: \"kubernetes.io/projected/6e672cde-60c3-4c2e-a162-6487f41171bc-kube-api-access-kgsqp\") pod \"ingress-canary-6r5fx\" (UID: \"6e672cde-60c3-4c2e-a162-6487f41171bc\") " pod="openshift-ingress-canary/ingress-canary-6r5fx" Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080751 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-snapshots\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.080858 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:58:49.080963 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.080870 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774947cc59-8b9t8: secret "image-registry-tls" not found Jul 06 23:58:49.081544 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.080971 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd9d5c53-ba09-4586-a544-88ea6352bb0c-trusted-ca\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:49.081544 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.081037 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls podName:e4a52377-d4a6-46ba-97f7-7c439d1cd40b nodeName:}" failed. No retries permitted until 2026-07-06 23:58:49.581022591 +0000 UTC m=+37.011443333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls") pod "image-registry-774947cc59-8b9t8" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b") : secret "image-registry-tls" not found Jul 06 23:58:49.081544 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.081429 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9deeccd6-365c-43a1-b6d9-d564a21cde0a-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:49.082081 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.082036 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-trusted-ca\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.084394 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.084372 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-installation-pull-secrets\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.084467 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.084410 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-image-registry-private-configuration\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.084511 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.084490 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8daf16ad-e5d6-40ff-bce7-c50d3519edac-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm\" (UID: \"8daf16ad-e5d6-40ff-bce7-c50d3519edac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" Jul 06 23:58:49.084596 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.084515 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/935eb03a-7e2a-4e71-b8fe-6d10043454b6-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d4bf7fb65-czdwm\" (UID: \"935eb03a-7e2a-4e71-b8fe-6d10043454b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:49.084818 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.084796 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-serving-cert\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.084879 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.084819 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd9d5c53-ba09-4586-a544-88ea6352bb0c-serving-cert\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:49.098914 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.098894 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpg6h\" (UniqueName: \"kubernetes.io/projected/8daf16ad-e5d6-40ff-bce7-c50d3519edac-kube-api-access-dpg6h\") pod \"managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm\" (UID: \"8daf16ad-e5d6-40ff-bce7-c50d3519edac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" Jul 06 23:58:49.099478 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.099055 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc9w7\" (UniqueName: \"kubernetes.io/projected/9deeccd6-365c-43a1-b6d9-d564a21cde0a-kube-api-access-lc9w7\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:49.101613 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.101595 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-bound-sa-token\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.102114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.102085 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fblsd\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-kube-api-access-fblsd\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.103069 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.103027 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgbn6\" (UniqueName: \"kubernetes.io/projected/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-kube-api-access-tgbn6\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:58:49.103638 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.103619 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhxjj\" (UniqueName: \"kubernetes.io/projected/935eb03a-7e2a-4e71-b8fe-6d10043454b6-kube-api-access-qhxjj\") pod \"klusterlet-addon-workmgr-7d4bf7fb65-czdwm\" (UID: \"935eb03a-7e2a-4e71-b8fe-6d10043454b6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:49.104818 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.104797 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pzwt\" (UniqueName: \"kubernetes.io/projected/5635d7b0-c65d-47a3-9b86-ca1a0f059d25-kube-api-access-9pzwt\") pod \"insights-operator-5c847dcfc4-fpxq2\" (UID: \"5635d7b0-c65d-47a3-9b86-ca1a0f059d25\") " pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.105191 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.105164 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkvjz\" (UniqueName: \"kubernetes.io/projected/cd9d5c53-ba09-4586-a544-88ea6352bb0c-kube-api-access-nkvjz\") pod \"console-operator-68b757fb67-kjfjg\" (UID: \"cd9d5c53-ba09-4586-a544-88ea6352bb0c\") " pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:49.180864 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.180831 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/994bf19b-30bc-495b-9c52-31c1cf0ae962-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.181030 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.180871 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sld2z\" (UniqueName: \"kubernetes.io/projected/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-kube-api-access-sld2z\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.181030 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.180903 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8r28\" (UniqueName: \"kubernetes.io/projected/996107f2-75f4-4da3-a4d0-5938ed1fc92e-kube-api-access-h8r28\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.181030 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.180929 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.181030 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.180953 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zl99\" (UniqueName: \"kubernetes.io/projected/7674237c-9c02-45a9-bcef-6418a5da70f3-kube-api-access-6zl99\") pod \"volume-data-source-validator-5d456fdbcd-4dc4w\" (UID: \"7674237c-9c02-45a9-bcef-6418a5da70f3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w" Jul 06 23:58:49.181030 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.180973 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.181030 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.180988 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdgcj\" (UniqueName: \"kubernetes.io/projected/994bf19b-30bc-495b-9c52-31c1cf0ae962-kube-api-access-vdgcj\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.181030 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181027 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.181396 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.181050 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:58:49.181396 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.181120 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:58:49.681102074 +0000 UTC m=+37.111522817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : secret "router-metrics-certs-default" not found Jul 06 23:58:49.181396 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181057 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgsqp\" (UniqueName: \"kubernetes.io/projected/6e672cde-60c3-4c2e-a162-6487f41171bc-kube-api-access-kgsqp\") pod \"ingress-canary-6r5fx\" (UID: \"6e672cde-60c3-4c2e-a162-6487f41171bc\") " pod="openshift-ingress-canary/ingress-canary-6r5fx" Jul 06 23:58:49.181396 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181259 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-tmp-dir\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.181396 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181307 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-ca\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.181396 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181334 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-hub\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.181396 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181358 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-stats-auth\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.181396 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181385 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.181778 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181421 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-default-certificate\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.181778 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181448 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.181778 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181493 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e672cde-60c3-4c2e-a162-6487f41171bc-cert\") pod \"ingress-canary-6r5fx\" (UID: \"6e672cde-60c3-4c2e-a162-6487f41171bc\") " pod="openshift-ingress-canary/ingress-canary-6r5fx" Jul 06 23:58:49.181778 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181521 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-config-volume\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.181778 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181611 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/994bf19b-30bc-495b-9c52-31c1cf0ae962-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.181778 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.181703 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:58:49.181778 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.181762 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls podName:56c9a5c2-3cfd-4d15-a61a-9831990f5e1b nodeName:}" failed. No retries permitted until 2026-07-06 23:58:49.681744519 +0000 UTC m=+37.112165263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls") pod "dns-default-4lc7t" (UID: "56c9a5c2-3cfd-4d15-a61a-9831990f5e1b") : secret "dns-default-metrics-tls" not found Jul 06 23:58:49.182095 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.181788 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:58:49.68176848 +0000 UTC m=+37.112189242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : configmap references non-existent config key: service-ca.crt Jul 06 23:58:49.182095 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.181882 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-tmp-dir\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.182194 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.182104 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-config-volume\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.184332 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.184300 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.184453 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.184351 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e672cde-60c3-4c2e-a162-6487f41171bc-cert\") pod \"ingress-canary-6r5fx\" (UID: \"6e672cde-60c3-4c2e-a162-6487f41171bc\") " pod="openshift-ingress-canary/ingress-canary-6r5fx" Jul 06 23:58:49.184453 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.184381 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.184629 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.184606 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-hub\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.184690 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.184660 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-stats-auth\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.185665 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.185639 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-default-certificate\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.185924 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.185907 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/994bf19b-30bc-495b-9c52-31c1cf0ae962-ca\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.195401 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.195380 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sld2z\" (UniqueName: \"kubernetes.io/projected/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-kube-api-access-sld2z\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.195704 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.195680 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgsqp\" (UniqueName: \"kubernetes.io/projected/6e672cde-60c3-4c2e-a162-6487f41171bc-kube-api-access-kgsqp\") pod \"ingress-canary-6r5fx\" (UID: \"6e672cde-60c3-4c2e-a162-6487f41171bc\") " pod="openshift-ingress-canary/ingress-canary-6r5fx" Jul 06 23:58:49.196180 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.196154 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8r28\" (UniqueName: \"kubernetes.io/projected/996107f2-75f4-4da3-a4d0-5938ed1fc92e-kube-api-access-h8r28\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.200736 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.200717 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zl99\" (UniqueName: \"kubernetes.io/projected/7674237c-9c02-45a9-bcef-6418a5da70f3-kube-api-access-6zl99\") pod \"volume-data-source-validator-5d456fdbcd-4dc4w\" (UID: \"7674237c-9c02-45a9-bcef-6418a5da70f3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w" Jul 06 23:58:49.202533 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.202511 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:58:49.208904 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.208886 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdgcj\" (UniqueName: \"kubernetes.io/projected/994bf19b-30bc-495b-9c52-31c1cf0ae962-kube-api-access-vdgcj\") pod \"cluster-proxy-proxy-agent-84b599c8f4-cbrxl\" (UID: \"994bf19b-30bc-495b-9c52-31c1cf0ae962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.224205 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.224186 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" Jul 06 23:58:49.234880 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.234863 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:58:49.249882 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.249862 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" Jul 06 23:58:49.256648 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.256628 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w" Jul 06 23:58:49.276875 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.276855 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 06 23:58:49.295720 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.295705 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6r5fx" Jul 06 23:58:49.585166 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.585120 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:49.585378 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.585216 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:58:49.585378 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.585314 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:58:49.585378 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.585334 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774947cc59-8b9t8: secret "image-registry-tls" not found Jul 06 23:58:49.585378 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.585342 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:58:49.585577 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.585397 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls podName:e4a52377-d4a6-46ba-97f7-7c439d1cd40b nodeName:}" failed. No retries permitted until 2026-07-06 23:58:50.58537944 +0000 UTC m=+38.015800198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls") pod "image-registry-774947cc59-8b9t8" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b") : secret "image-registry-tls" not found Jul 06 23:58:49.585577 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.585415 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls podName:40e3706d-104f-4a61-96c9-f8e6ecb4e0b2 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:50.585407182 +0000 UTC m=+38.015827921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww9ms" (UID: "40e3706d-104f-4a61-96c9-f8e6ecb4e0b2") : secret "samples-operator-tls" not found Jul 06 23:58:49.585577 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.585391 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:49.585577 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.585461 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:58:49.585577 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.585516 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls podName:9deeccd6-365c-43a1-b6d9-d564a21cde0a nodeName:}" failed. No retries permitted until 2026-07-06 23:58:50.585504354 +0000 UTC m=+38.015925102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dtr5b" (UID: "9deeccd6-365c-43a1-b6d9-d564a21cde0a") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:58:49.686867 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.686837 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:49.686867 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.686874 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.687080 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.686988 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:58:49.687080 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.687044 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls podName:56c9a5c2-3cfd-4d15-a61a-9831990f5e1b nodeName:}" failed. No retries permitted until 2026-07-06 23:58:50.687029683 +0000 UTC m=+38.117450421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls") pod "dns-default-4lc7t" (UID: "56c9a5c2-3cfd-4d15-a61a-9831990f5e1b") : secret "dns-default-metrics-tls" not found Jul 06 23:58:49.687080 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.687063 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:49.687207 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.687138 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:58:50.687119961 +0000 UTC m=+38.117540721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : configmap references non-existent config key: service-ca.crt Jul 06 23:58:49.687207 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.687152 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:58:49.687207 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:49.687173 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:58:50.687167244 +0000 UTC m=+38.117587982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : secret "router-metrics-certs-default" not found Jul 06 23:58:49.935259 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.935028 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm"] Jul 06 23:58:49.938349 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:49.938322 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8daf16ad_e5d6_40ff_bce7_c50d3519edac.slice/crio-c5e563d39686ce825e6cd01abf6554594ee0fe70144b38e9794718eb13003b69 WatchSource:0}: Error finding container c5e563d39686ce825e6cd01abf6554594ee0fe70144b38e9794718eb13003b69: Status 404 returned error can't find the container with id c5e563d39686ce825e6cd01abf6554594ee0fe70144b38e9794718eb13003b69 Jul 06 23:58:49.938965 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.938935 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl"] Jul 06 23:58:49.940373 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.940311 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm"] Jul 06 23:58:49.941657 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.941416 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-kjfjg"] Jul 06 23:58:49.942862 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.942540 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w"] Jul 06 23:58:49.943436 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:49.943407 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7674237c_9c02_45a9_bcef_6418a5da70f3.slice/crio-eca9338c604925f3737c88fa2d973c46a10c4eb02e2c66774092f514f20e069d WatchSource:0}: Error finding container eca9338c604925f3737c88fa2d973c46a10c4eb02e2c66774092f514f20e069d: Status 404 returned error can't find the container with id eca9338c604925f3737c88fa2d973c46a10c4eb02e2c66774092f514f20e069d Jul 06 23:58:49.944184 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:49.944130 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod994bf19b_30bc_495b_9c52_31c1cf0ae962.slice/crio-911277e76dc37927e91429735293f614acff2d7111077e9cf617172cf890b248 WatchSource:0}: Error finding container 911277e76dc37927e91429735293f614acff2d7111077e9cf617172cf890b248: Status 404 returned error can't find the container with id 911277e76dc37927e91429735293f614acff2d7111077e9cf617172cf890b248 Jul 06 23:58:49.945931 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:49.945744 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935eb03a_7e2a_4e71_b8fe_6d10043454b6.slice/crio-1f6ec7a51d3cc77dd1372c686f4241cffa86825573e816ab20f3be2ff68a9e38 WatchSource:0}: Error finding container 1f6ec7a51d3cc77dd1372c686f4241cffa86825573e816ab20f3be2ff68a9e38: Status 404 returned error can't find the container with id 1f6ec7a51d3cc77dd1372c686f4241cffa86825573e816ab20f3be2ff68a9e38 Jul 06 23:58:49.956025 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.955989 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6r5fx"] Jul 06 23:58:49.957115 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:49.957093 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-fpxq2"] Jul 06 23:58:49.958618 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:49.958599 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5635d7b0_c65d_47a3_9b86_ca1a0f059d25.slice/crio-8901138e0f3f360e647a8c09fbf661ae6abe5f7c3a5761641d0bbd294b0e857c WatchSource:0}: Error finding container 8901138e0f3f360e647a8c09fbf661ae6abe5f7c3a5761641d0bbd294b0e857c: Status 404 returned error can't find the container with id 8901138e0f3f360e647a8c09fbf661ae6abe5f7c3a5761641d0bbd294b0e857c Jul 06 23:58:49.959837 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:49.959813 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e672cde_60c3_4c2e_a162_6487f41171bc.slice/crio-3c2717d70df4b4ebed76470b06c6d98f77bfe6608a93661c6d0b036d8ca8e7ad WatchSource:0}: Error finding container 3c2717d70df4b4ebed76470b06c6d98f77bfe6608a93661c6d0b036d8ca8e7ad: Status 404 returned error can't find the container with id 3c2717d70df4b4ebed76470b06c6d98f77bfe6608a93661c6d0b036d8ca8e7ad Jul 06 23:58:50.085614 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.085591 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:58:50.085614 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.085600 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:58:50.085860 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.085839 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:58:50.088388 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.088370 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:58:50.088486 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.088397 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:58:50.088486 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.088397 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:58:50.088486 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.088403 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6shd9\"" Jul 06 23:58:50.088634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.088446 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:58:50.088634 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.088449 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dn54q\"" Jul 06 23:58:50.380007 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.379923 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl"] Jul 06 23:58:50.383340 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.383315 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.385745 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.385721 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 23:58:50.385845 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.385806 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:58:50.385926 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.385895 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-85cb8\"" Jul 06 23:58:50.386050 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.385975 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 23:58:50.386050 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.386022 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 23:58:50.389712 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.389679 2549 generic.go:356] "Generic (PLEG): container finished" podID="36f35e1e-7949-4839-918c-d20509e3bb21" containerID="0658118bb381cd09bfd5f19935cb124e6c61c827af5e5aefa1f030b2ab5e1506" exitCode=0 Jul 06 23:58:50.389794 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.389757 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" event={"ID":"36f35e1e-7949-4839-918c-d20509e3bb21","Type":"ContainerDied","Data":"0658118bb381cd09bfd5f19935cb124e6c61c827af5e5aefa1f030b2ab5e1506"} Jul 06 23:58:50.392110 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.391740 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" event={"ID":"cd9d5c53-ba09-4586-a544-88ea6352bb0c","Type":"ContainerStarted","Data":"b660aef4bebac54baafe37b048a2ab0c263029122d588a97c4bc697a475cc79d"} Jul 06 23:58:50.392398 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.392289 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl"] Jul 06 23:58:50.395097 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.395075 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" event={"ID":"994bf19b-30bc-495b-9c52-31c1cf0ae962","Type":"ContainerStarted","Data":"911277e76dc37927e91429735293f614acff2d7111077e9cf617172cf890b248"} Jul 06 23:58:50.396408 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.396386 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w" event={"ID":"7674237c-9c02-45a9-bcef-6418a5da70f3","Type":"ContainerStarted","Data":"eca9338c604925f3737c88fa2d973c46a10c4eb02e2c66774092f514f20e069d"} Jul 06 23:58:50.397887 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.397865 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6r5fx" event={"ID":"6e672cde-60c3-4c2e-a162-6487f41171bc","Type":"ContainerStarted","Data":"3c2717d70df4b4ebed76470b06c6d98f77bfe6608a93661c6d0b036d8ca8e7ad"} Jul 06 23:58:50.399198 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.399170 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" event={"ID":"935eb03a-7e2a-4e71-b8fe-6d10043454b6","Type":"ContainerStarted","Data":"1f6ec7a51d3cc77dd1372c686f4241cffa86825573e816ab20f3be2ff68a9e38"} Jul 06 23:58:50.400508 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.400430 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" event={"ID":"8daf16ad-e5d6-40ff-bce7-c50d3519edac","Type":"ContainerStarted","Data":"c5e563d39686ce825e6cd01abf6554594ee0fe70144b38e9794718eb13003b69"} Jul 06 23:58:50.401656 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.401633 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" event={"ID":"5635d7b0-c65d-47a3-9b86-ca1a0f059d25","Type":"ContainerStarted","Data":"8901138e0f3f360e647a8c09fbf661ae6abe5f7c3a5761641d0bbd294b0e857c"} Jul 06 23:58:50.495340 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.494757 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/182215b6-8b23-4f4e-bb64-2302a1b08eae-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-hlhtl\" (UID: \"182215b6-8b23-4f4e-bb64-2302a1b08eae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.495340 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.494836 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgfb4\" (UniqueName: \"kubernetes.io/projected/182215b6-8b23-4f4e-bb64-2302a1b08eae-kube-api-access-fgfb4\") pod \"kube-storage-version-migrator-operator-846bf668f7-hlhtl\" (UID: \"182215b6-8b23-4f4e-bb64-2302a1b08eae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.495340 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.494871 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/182215b6-8b23-4f4e-bb64-2302a1b08eae-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-hlhtl\" (UID: \"182215b6-8b23-4f4e-bb64-2302a1b08eae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.596079 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.596129 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/182215b6-8b23-4f4e-bb64-2302a1b08eae-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-hlhtl\" (UID: \"182215b6-8b23-4f4e-bb64-2302a1b08eae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.596197 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgfb4\" (UniqueName: \"kubernetes.io/projected/182215b6-8b23-4f4e-bb64-2302a1b08eae-kube-api-access-fgfb4\") pod \"kube-storage-version-migrator-operator-846bf668f7-hlhtl\" (UID: \"182215b6-8b23-4f4e-bb64-2302a1b08eae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.596259 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.596287 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/182215b6-8b23-4f4e-bb64-2302a1b08eae-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-hlhtl\" (UID: \"182215b6-8b23-4f4e-bb64-2302a1b08eae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.596327 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.596559 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.596636 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls podName:9deeccd6-365c-43a1-b6d9-d564a21cde0a nodeName:}" failed. No retries permitted until 2026-07-06 23:58:52.596607447 +0000 UTC m=+40.027028190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dtr5b" (UID: "9deeccd6-365c-43a1-b6d9-d564a21cde0a") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.597055 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.597085 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.597100 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774947cc59-8b9t8: secret "image-registry-tls" not found Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.597107 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls podName:40e3706d-104f-4a61-96c9-f8e6ecb4e0b2 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:52.597091809 +0000 UTC m=+40.027512564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww9ms" (UID: "40e3706d-104f-4a61-96c9-f8e6ecb4e0b2") : secret "samples-operator-tls" not found Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.597134 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls podName:e4a52377-d4a6-46ba-97f7-7c439d1cd40b nodeName:}" failed. No retries permitted until 2026-07-06 23:58:52.597123667 +0000 UTC m=+40.027544406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls") pod "image-registry-774947cc59-8b9t8" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b") : secret "image-registry-tls" not found Jul 06 23:58:50.597730 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.597723 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/182215b6-8b23-4f4e-bb64-2302a1b08eae-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-hlhtl\" (UID: \"182215b6-8b23-4f4e-bb64-2302a1b08eae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.609125 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.609065 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/182215b6-8b23-4f4e-bb64-2302a1b08eae-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-hlhtl\" (UID: \"182215b6-8b23-4f4e-bb64-2302a1b08eae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.611203 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.611175 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgfb4\" (UniqueName: \"kubernetes.io/projected/182215b6-8b23-4f4e-bb64-2302a1b08eae-kube-api-access-fgfb4\") pod \"kube-storage-version-migrator-operator-846bf668f7-hlhtl\" (UID: \"182215b6-8b23-4f4e-bb64-2302a1b08eae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.695394 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.695172 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" Jul 06 23:58:50.700598 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.698684 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:50.700598 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.698737 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:50.700598 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.698992 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:50.700598 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.700366 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:58:50.700598 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.700564 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:58:52.700536557 +0000 UTC m=+40.130957323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : configmap references non-existent config key: service-ca.crt Jul 06 23:58:50.708358 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.701486 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:58:50.708358 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.701544 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:58:52.701528719 +0000 UTC m=+40.131949462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : secret "router-metrics-certs-default" not found Jul 06 23:58:50.708358 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:50.702833 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls podName:56c9a5c2-3cfd-4d15-a61a-9831990f5e1b nodeName:}" failed. No retries permitted until 2026-07-06 23:58:52.702814093 +0000 UTC m=+40.133234845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls") pod "dns-default-4lc7t" (UID: "56c9a5c2-3cfd-4d15-a61a-9831990f5e1b") : secret "dns-default-metrics-tls" not found Jul 06 23:58:50.888143 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:50.888025 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl"] Jul 06 23:58:50.896179 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:50.896141 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182215b6_8b23_4f4e_bb64_2302a1b08eae.slice/crio-f42447ec4cd0988a430247371ee4745ce71b9d9487b0b4a42bac7fed7c5b3ca9 WatchSource:0}: Error finding container f42447ec4cd0988a430247371ee4745ce71b9d9487b0b4a42bac7fed7c5b3ca9: Status 404 returned error can't find the container with id f42447ec4cd0988a430247371ee4745ce71b9d9487b0b4a42bac7fed7c5b3ca9 Jul 06 23:58:51.380476 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.379376 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l"] Jul 06 23:58:51.390865 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.386268 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:51.391928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.391438 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 23:58:51.391928 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.391671 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8glqs\"" Jul 06 23:58:51.399769 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.399647 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 23:58:51.400383 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.399914 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 23:58:51.400383 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.400201 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:58:51.403632 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.402485 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l"] Jul 06 23:58:51.413728 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.413656 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" event={"ID":"36f35e1e-7949-4839-918c-d20509e3bb21","Type":"ContainerDied","Data":"2bb2adffbd0fc7fa1aff4942d3e92a92be1f849115b98d10801159221666ac57"} Jul 06 23:58:51.413728 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.413693 2549 generic.go:356] "Generic (PLEG): container finished" podID="36f35e1e-7949-4839-918c-d20509e3bb21" containerID="2bb2adffbd0fc7fa1aff4942d3e92a92be1f849115b98d10801159221666ac57" exitCode=0 Jul 06 23:58:51.421140 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.421080 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" event={"ID":"182215b6-8b23-4f4e-bb64-2302a1b08eae","Type":"ContainerStarted","Data":"f42447ec4cd0988a430247371ee4745ce71b9d9487b0b4a42bac7fed7c5b3ca9"} Jul 06 23:58:51.506261 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.505728 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr44q\" (UniqueName: \"kubernetes.io/projected/bc3cc7d0-0019-416b-8f66-ba6ebe388b25-kube-api-access-zr44q\") pod \"service-ca-operator-5d46d9ffd4-dfq6l\" (UID: \"bc3cc7d0-0019-416b-8f66-ba6ebe388b25\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:51.506261 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.505827 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc3cc7d0-0019-416b-8f66-ba6ebe388b25-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-dfq6l\" (UID: \"bc3cc7d0-0019-416b-8f66-ba6ebe388b25\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:51.506261 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.506007 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc3cc7d0-0019-416b-8f66-ba6ebe388b25-config\") pod \"service-ca-operator-5d46d9ffd4-dfq6l\" (UID: \"bc3cc7d0-0019-416b-8f66-ba6ebe388b25\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:51.609284 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.607246 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr44q\" (UniqueName: \"kubernetes.io/projected/bc3cc7d0-0019-416b-8f66-ba6ebe388b25-kube-api-access-zr44q\") pod \"service-ca-operator-5d46d9ffd4-dfq6l\" (UID: \"bc3cc7d0-0019-416b-8f66-ba6ebe388b25\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:51.609284 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.607334 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc3cc7d0-0019-416b-8f66-ba6ebe388b25-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-dfq6l\" (UID: \"bc3cc7d0-0019-416b-8f66-ba6ebe388b25\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:51.609284 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.607451 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc3cc7d0-0019-416b-8f66-ba6ebe388b25-config\") pod \"service-ca-operator-5d46d9ffd4-dfq6l\" (UID: \"bc3cc7d0-0019-416b-8f66-ba6ebe388b25\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:51.609284 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.608526 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc3cc7d0-0019-416b-8f66-ba6ebe388b25-config\") pod \"service-ca-operator-5d46d9ffd4-dfq6l\" (UID: \"bc3cc7d0-0019-416b-8f66-ba6ebe388b25\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:51.622747 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.622484 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc3cc7d0-0019-416b-8f66-ba6ebe388b25-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-dfq6l\" (UID: \"bc3cc7d0-0019-416b-8f66-ba6ebe388b25\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:51.628262 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.628195 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr44q\" (UniqueName: \"kubernetes.io/projected/bc3cc7d0-0019-416b-8f66-ba6ebe388b25-kube-api-access-zr44q\") pod \"service-ca-operator-5d46d9ffd4-dfq6l\" (UID: \"bc3cc7d0-0019-416b-8f66-ba6ebe388b25\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:51.704741 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:51.704505 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" Jul 06 23:58:52.032420 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.032393 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l"] Jul 06 23:58:52.034795 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:58:52.034755 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3cc7d0_0019_416b_8f66_ba6ebe388b25.slice/crio-b441f2070c4d0f290ccffce94f236bf7f8426870b70f22f8fc28f8734dd5b0a6 WatchSource:0}: Error finding container b441f2070c4d0f290ccffce94f236bf7f8426870b70f22f8fc28f8734dd5b0a6: Status 404 returned error can't find the container with id b441f2070c4d0f290ccffce94f236bf7f8426870b70f22f8fc28f8734dd5b0a6 Jul 06 23:58:52.444312 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.443792 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" event={"ID":"36f35e1e-7949-4839-918c-d20509e3bb21","Type":"ContainerStarted","Data":"030f0897eeb047e67fbff1c1b63a34cb81ac9a67365b26cdfe2643f10736c769"} Jul 06 23:58:52.445646 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.445608 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" event={"ID":"bc3cc7d0-0019-416b-8f66-ba6ebe388b25","Type":"ContainerStarted","Data":"b441f2070c4d0f290ccffce94f236bf7f8426870b70f22f8fc28f8734dd5b0a6"} Jul 06 23:58:52.447901 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.447840 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w" event={"ID":"7674237c-9c02-45a9-bcef-6418a5da70f3","Type":"ContainerStarted","Data":"19ff0e8258a8f376f5161cf58b09ed6efd1fe8fe588903dc21d012d6c0d935f5"} Jul 06 23:58:52.469172 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.468764 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8nh8b" podStartSLOduration=9.108147176 podStartE2EDuration="39.468745653s" totalImagesPullingTime="30.360598477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:52.467022076 +0000 UTC m=+39.897442860" watchObservedRunningTime="2026-07-06 23:58:52.468745653 +0000 UTC m=+39.899166395" Jul 06 23:58:52.486035 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.485688 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4dc4w" podStartSLOduration=5.168029604 podStartE2EDuration="7.485675981s" totalImagesPullingTime="2.317646377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:52.48549644 +0000 UTC m=+39.915917201" watchObservedRunningTime="2026-07-06 23:58:52.485675981 +0000 UTC m=+39.916096743" Jul 06 23:58:52.619755 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.618530 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:52.619755 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.618619 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:58:52.619755 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.618676 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:52.619755 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.618877 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:58:52.619755 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.618955 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls podName:40e3706d-104f-4a61-96c9-f8e6ecb4e0b2 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:56.618932703 +0000 UTC m=+44.049353443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww9ms" (UID: "40e3706d-104f-4a61-96c9-f8e6ecb4e0b2") : secret "samples-operator-tls" not found Jul 06 23:58:52.619755 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.619577 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:58:52.619755 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.619591 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774947cc59-8b9t8: secret "image-registry-tls" not found Jul 06 23:58:52.619755 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.619633 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls podName:e4a52377-d4a6-46ba-97f7-7c439d1cd40b nodeName:}" failed. No retries permitted until 2026-07-06 23:58:56.619619385 +0000 UTC m=+44.050040128 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls") pod "image-registry-774947cc59-8b9t8" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b") : secret "image-registry-tls" not found Jul 06 23:58:52.619755 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.619744 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:58:52.620297 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.619860 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls podName:9deeccd6-365c-43a1-b6d9-d564a21cde0a nodeName:}" failed. No retries permitted until 2026-07-06 23:58:56.619789777 +0000 UTC m=+44.050210517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dtr5b" (UID: "9deeccd6-365c-43a1-b6d9-d564a21cde0a") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:58:52.719649 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.719350 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:52.719649 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.719490 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:52.719649 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.719496 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:58:52.719649 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:52.719524 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:52.719649 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.719558 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:58:56.719540788 +0000 UTC m=+44.149961619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : secret "router-metrics-certs-default" not found Jul 06 23:58:52.719649 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.719620 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:58:56.719610176 +0000 UTC m=+44.150030920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : configmap references non-existent config key: service-ca.crt Jul 06 23:58:52.719649 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.719651 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:58:52.720113 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:52.719712 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls podName:56c9a5c2-3cfd-4d15-a61a-9831990f5e1b nodeName:}" failed. No retries permitted until 2026-07-06 23:58:56.719694338 +0000 UTC m=+44.150115096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls") pod "dns-default-4lc7t" (UID: "56c9a5c2-3cfd-4d15-a61a-9831990f5e1b") : secret "dns-default-metrics-tls" not found Jul 06 23:58:56.657750 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:56.657517 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:58:56.658183 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.657663 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:58:56.658183 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:56.657863 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:58:56.658183 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.657882 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls podName:9deeccd6-365c-43a1-b6d9-d564a21cde0a nodeName:}" failed. No retries permitted until 2026-07-06 23:59:04.657861831 +0000 UTC m=+52.088282583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dtr5b" (UID: "9deeccd6-365c-43a1-b6d9-d564a21cde0a") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:58:56.658183 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.657940 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:58:56.658183 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.657953 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774947cc59-8b9t8: secret "image-registry-tls" not found Jul 06 23:58:56.658183 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:56.657959 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:58:56.658183 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.657988 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls podName:e4a52377-d4a6-46ba-97f7-7c439d1cd40b nodeName:}" failed. No retries permitted until 2026-07-06 23:59:04.657977891 +0000 UTC m=+52.088398640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls") pod "image-registry-774947cc59-8b9t8" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b") : secret "image-registry-tls" not found Jul 06 23:58:56.658183 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.658042 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:58:56.658183 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.658076 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls podName:40e3706d-104f-4a61-96c9-f8e6ecb4e0b2 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:04.658064974 +0000 UTC m=+52.088485714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww9ms" (UID: "40e3706d-104f-4a61-96c9-f8e6ecb4e0b2") : secret "samples-operator-tls" not found Jul 06 23:58:56.758521 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:56.758478 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:58:56.758521 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:56.758532 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:56.758758 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:58:56.758597 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:58:56.758758 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.758655 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:58:56.758758 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.758714 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:59:04.758691121 +0000 UTC m=+52.189111867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : configmap references non-existent config key: service-ca.crt Jul 06 23:58:56.758758 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.758742 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls podName:56c9a5c2-3cfd-4d15-a61a-9831990f5e1b nodeName:}" failed. No retries permitted until 2026-07-06 23:59:04.758732102 +0000 UTC m=+52.189152852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls") pod "dns-default-4lc7t" (UID: "56c9a5c2-3cfd-4d15-a61a-9831990f5e1b") : secret "dns-default-metrics-tls" not found Jul 06 23:58:56.758939 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.758765 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:58:56.758939 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:58:56.758854 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:59:04.75884138 +0000 UTC m=+52.189262122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : secret "router-metrics-certs-default" not found Jul 06 23:59:00.470325 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.470298 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/0.log" Jul 06 23:59:00.470792 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.470342 2549 generic.go:356] "Generic (PLEG): container finished" podID="cd9d5c53-ba09-4586-a544-88ea6352bb0c" containerID="d935d234993cdd672b3c5cacfb98d8c985aa8b65c4b29164b9f127b3e7e4ca82" exitCode=255 Jul 06 23:59:00.470792 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.470433 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" event={"ID":"cd9d5c53-ba09-4586-a544-88ea6352bb0c","Type":"ContainerDied","Data":"d935d234993cdd672b3c5cacfb98d8c985aa8b65c4b29164b9f127b3e7e4ca82"} Jul 06 23:59:00.470792 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.470639 2549 scope.go:117] "RemoveContainer" containerID="d935d234993cdd672b3c5cacfb98d8c985aa8b65c4b29164b9f127b3e7e4ca82" Jul 06 23:59:00.472945 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.472859 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" event={"ID":"994bf19b-30bc-495b-9c52-31c1cf0ae962","Type":"ContainerStarted","Data":"1fa2bce85cf3079995c1bdef3a675d2eb2bd83132d97bc5eb3aade79f7d52762"} Jul 06 23:59:00.472945 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.472900 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" event={"ID":"994bf19b-30bc-495b-9c52-31c1cf0ae962","Type":"ContainerStarted","Data":"d9232114afa5171143333f17c85c279f15cc0fa75b02686a9571faf7aa509735"} Jul 06 23:59:00.472945 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.472922 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" event={"ID":"994bf19b-30bc-495b-9c52-31c1cf0ae962","Type":"ContainerStarted","Data":"3ab3f6deab0958606a22d6d17241d01e7a088affd04f3489cde398c37ede2573"} Jul 06 23:59:00.474473 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.474447 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" event={"ID":"bc3cc7d0-0019-416b-8f66-ba6ebe388b25","Type":"ContainerStarted","Data":"6ffb21304edf08e7ec8440780229d89f23eb6f233c510d587d53483a00b74d12"} Jul 06 23:59:00.475996 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.475974 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6r5fx" event={"ID":"6e672cde-60c3-4c2e-a162-6487f41171bc","Type":"ContainerStarted","Data":"06c17da3b98a2336b5483eaf7a56a8376cbeab9a6f5c423bc84380089e699688"} Jul 06 23:59:00.477451 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.477427 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" event={"ID":"8daf16ad-e5d6-40ff-bce7-c50d3519edac","Type":"ContainerStarted","Data":"0e1ba61f7302d3cfe018a4df7b9382b79a966957e277f0ac7f6dc08e2c79efd0"} Jul 06 23:59:00.478873 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.478852 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" event={"ID":"5635d7b0-c65d-47a3-9b86-ca1a0f059d25","Type":"ContainerStarted","Data":"34c8aaa886340bfeadebcc7c0cb54a703afd21392e2d738e36aaea4ae9b1d335"} Jul 06 23:59:00.480358 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.480333 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" event={"ID":"182215b6-8b23-4f4e-bb64-2302a1b08eae","Type":"ContainerStarted","Data":"c8f95007e8d6f7643e23c42411c7ac0baa801cd0b8c7b2ae295f183c08835b24"} Jul 06 23:59:00.521729 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.521536 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" podStartSLOduration=20.840054477 podStartE2EDuration="30.521522067s" totalImagesPullingTime="9.68146759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:00.505603158 +0000 UTC m=+47.936023920" watchObservedRunningTime="2026-07-06 23:59:00.521522067 +0000 UTC m=+47.951942831" Jul 06 23:59:00.521729 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.521637 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" podStartSLOduration=1.812511218 podStartE2EDuration="10.521629291s" totalImagesPullingTime="8.709118073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:00.520681065 +0000 UTC m=+47.951101827" watchObservedRunningTime="2026-07-06 23:59:00.521629291 +0000 UTC m=+47.952050052" Jul 06 23:59:00.537960 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.537908 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" podStartSLOduration=9.904529754 podStartE2EDuration="19.53788841s" totalImagesPullingTime="9.633358656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:00.536709171 +0000 UTC m=+47.967129938" watchObservedRunningTime="2026-07-06 23:59:00.53788841 +0000 UTC m=+47.968309173" Jul 06 23:59:00.553583 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.553534 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" podStartSLOduration=1.8890371830000001 podStartE2EDuration="9.553515342s" totalImagesPullingTime="7.664478159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:00.551877388 +0000 UTC m=+47.982298153" watchObservedRunningTime="2026-07-06 23:59:00.553515342 +0000 UTC m=+47.983936104" Jul 06 23:59:00.572342 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.572304 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fcc84dd64-s5qfm" podStartSLOduration=20.897037146 podStartE2EDuration="30.572287394s" totalImagesPullingTime="9.675250248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:00.571519846 +0000 UTC m=+48.001940612" watchObservedRunningTime="2026-07-06 23:59:00.572287394 +0000 UTC m=+48.002708153" Jul 06 23:59:00.589830 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:00.589790 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6r5fx" podStartSLOduration=2.9572978709999997 podStartE2EDuration="12.589775362s" totalImagesPullingTime="9.632477491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:00.588549062 +0000 UTC m=+48.018969823" watchObservedRunningTime="2026-07-06 23:59:00.589775362 +0000 UTC m=+48.020196124" Jul 06 23:59:01.489269 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:01.489240 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/1.log" Jul 06 23:59:01.489733 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:01.489679 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/0.log" Jul 06 23:59:01.489733 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:01.489712 2549 generic.go:356] "Generic (PLEG): container finished" podID="cd9d5c53-ba09-4586-a544-88ea6352bb0c" containerID="2f3dd6099c2cdb2b7155b68e1b6213b4768403236c9ef785082bd217d7c0502e" exitCode=255 Jul 06 23:59:01.489842 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:01.489745 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" event={"ID":"cd9d5c53-ba09-4586-a544-88ea6352bb0c","Type":"ContainerDied","Data":"2f3dd6099c2cdb2b7155b68e1b6213b4768403236c9ef785082bd217d7c0502e"} Jul 06 23:59:01.489842 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:01.489824 2549 scope.go:117] "RemoveContainer" containerID="d935d234993cdd672b3c5cacfb98d8c985aa8b65c4b29164b9f127b3e7e4ca82" Jul 06 23:59:01.490095 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:01.490079 2549 scope.go:117] "RemoveContainer" containerID="2f3dd6099c2cdb2b7155b68e1b6213b4768403236c9ef785082bd217d7c0502e" Jul 06 23:59:01.490316 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:01.490293 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-kjfjg_openshift-console-operator(cd9d5c53-ba09-4586-a544-88ea6352bb0c)\"" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" podUID="cd9d5c53-ba09-4586-a544-88ea6352bb0c" Jul 06 23:59:02.033112 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.033077 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6w7qf"] Jul 06 23:59:02.051644 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.051609 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6w7qf"] Jul 06 23:59:02.051806 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.051739 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.054161 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.054123 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 23:59:02.054347 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.054191 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 23:59:02.054347 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.054323 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6hpbz\"" Jul 06 23:59:02.109731 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.109696 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.109887 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.109736 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-crio-socket\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.109887 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.109802 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm2qg\" (UniqueName: \"kubernetes.io/projected/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-api-access-bm2qg\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.109887 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.109857 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-data-volume\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.109984 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.109906 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.210742 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.210707 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.210742 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.210747 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-crio-socket\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.210960 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.210787 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm2qg\" (UniqueName: \"kubernetes.io/projected/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-api-access-bm2qg\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.210960 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:02.210836 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:59:02.210960 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.210839 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-data-volume\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.210960 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:02.210902 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm podName:be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c nodeName:}" failed. No retries permitted until 2026-07-06 23:59:02.710887241 +0000 UTC m=+50.141307979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6w7qf" (UID: "be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c") : configmap "kube-rbac-proxy" not found Jul 06 23:59:02.210960 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.210941 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-crio-socket\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.211125 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.210975 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.211125 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:02.211102 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:59:02.211182 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.211135 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-data-volume\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.211182 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:02.211141 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls podName:be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c nodeName:}" failed. No retries permitted until 2026-07-06 23:59:02.711131189 +0000 UTC m=+50.141551932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6w7qf" (UID: "be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c") : secret "insights-runtime-extractor-tls" not found Jul 06 23:59:02.224146 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.224122 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm2qg\" (UniqueName: \"kubernetes.io/projected/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-api-access-bm2qg\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.498036 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.498007 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/1.log" Jul 06 23:59:02.498439 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.498361 2549 scope.go:117] "RemoveContainer" containerID="2f3dd6099c2cdb2b7155b68e1b6213b4768403236c9ef785082bd217d7c0502e" Jul 06 23:59:02.498543 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:02.498524 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-kjfjg_openshift-console-operator(cd9d5c53-ba09-4586-a544-88ea6352bb0c)\"" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" podUID="cd9d5c53-ba09-4586-a544-88ea6352bb0c" Jul 06 23:59:02.715182 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.715143 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.715391 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:02.715209 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:02.715391 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:02.715309 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:59:02.715391 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:02.715337 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:59:02.715516 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:02.715402 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls podName:be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c nodeName:}" failed. No retries permitted until 2026-07-06 23:59:03.715386742 +0000 UTC m=+51.145807482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6w7qf" (UID: "be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c") : secret "insights-runtime-extractor-tls" not found Jul 06 23:59:02.715516 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:02.715417 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm podName:be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c nodeName:}" failed. No retries permitted until 2026-07-06 23:59:03.715410282 +0000 UTC m=+51.145831020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6w7qf" (UID: "be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c") : configmap "kube-rbac-proxy" not found Jul 06 23:59:03.723467 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:03.723432 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:03.723962 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:03.723514 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:03.723962 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:03.723596 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:59:03.723962 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:03.723654 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls podName:be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c nodeName:}" failed. No retries permitted until 2026-07-06 23:59:05.723640882 +0000 UTC m=+53.154061624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6w7qf" (UID: "be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c") : secret "insights-runtime-extractor-tls" not found Jul 06 23:59:03.723962 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:03.723599 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 23:59:03.723962 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:03.723731 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm podName:be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c nodeName:}" failed. No retries permitted until 2026-07-06 23:59:05.723719438 +0000 UTC m=+53.154140178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6w7qf" (UID: "be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c") : configmap "kube-rbac-proxy" not found Jul 06 23:59:04.731829 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:04.731785 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:59:04.732300 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:04.731878 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:59:04.732300 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.731903 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 23:59:04.732300 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:04.731921 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:59:04.732300 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.731923 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774947cc59-8b9t8: secret "image-registry-tls" not found Jul 06 23:59:04.732300 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.731994 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls podName:e4a52377-d4a6-46ba-97f7-7c439d1cd40b nodeName:}" failed. No retries permitted until 2026-07-06 23:59:20.73197715 +0000 UTC m=+68.162397904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls") pod "image-registry-774947cc59-8b9t8" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b") : secret "image-registry-tls" not found Jul 06 23:59:04.732300 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.731999 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 23:59:04.732300 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.732019 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 23:59:04.732300 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.732050 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls podName:40e3706d-104f-4a61-96c9-f8e6ecb4e0b2 nodeName:}" failed. No retries permitted until 2026-07-06 23:59:20.732037106 +0000 UTC m=+68.162457845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww9ms" (UID: "40e3706d-104f-4a61-96c9-f8e6ecb4e0b2") : secret "samples-operator-tls" not found Jul 06 23:59:04.732300 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.732192 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls podName:9deeccd6-365c-43a1-b6d9-d564a21cde0a nodeName:}" failed. No retries permitted until 2026-07-06 23:59:20.732175688 +0000 UTC m=+68.162596427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dtr5b" (UID: "9deeccd6-365c-43a1-b6d9-d564a21cde0a") : secret "cluster-monitoring-operator-tls" not found Jul 06 23:59:04.832478 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:04.832449 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:04.832624 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:04.832560 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:59:04.832624 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:04.832589 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:04.832624 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.832594 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 23:59:04.832729 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.832657 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:59:20.832639192 +0000 UTC m=+68.263059932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : secret "router-metrics-certs-default" not found Jul 06 23:59:04.832729 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.832706 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 23:59:04.832729 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.832721 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle podName:996107f2-75f4-4da3-a4d0-5938ed1fc92e nodeName:}" failed. No retries permitted until 2026-07-06 23:59:20.832704576 +0000 UTC m=+68.263125318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle") pod "router-default-6f986b9999-lj82p" (UID: "996107f2-75f4-4da3-a4d0-5938ed1fc92e") : configmap references non-existent config key: service-ca.crt Jul 06 23:59:04.832827 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:04.832748 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls podName:56c9a5c2-3cfd-4d15-a61a-9831990f5e1b nodeName:}" failed. No retries permitted until 2026-07-06 23:59:20.8327364 +0000 UTC m=+68.263157154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls") pod "dns-default-4lc7t" (UID: "56c9a5c2-3cfd-4d15-a61a-9831990f5e1b") : secret "dns-default-metrics-tls" not found Jul 06 23:59:05.046695 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:05.046617 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p99kk_0ef8a894-bebe-4f5e-a93a-4ad0f902e528/dns-node-resolver/0.log" Jul 06 23:59:05.645712 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:05.645685 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4t2b6_9cab9320-c9c9-438c-816c-ee36d5177062/node-ca/0.log" Jul 06 23:59:05.740985 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:05.740950 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:05.741457 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:05.741090 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:05.741457 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:05.741101 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:59:05.741457 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:05.741182 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls podName:be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c nodeName:}" failed. No retries permitted until 2026-07-06 23:59:09.741162681 +0000 UTC m=+57.171583424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6w7qf" (UID: "be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c") : secret "insights-runtime-extractor-tls" not found Jul 06 23:59:05.741773 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:05.741750 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:06.446328 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:06.446295 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6r5fx_6e672cde-60c3-4c2e-a162-6487f41171bc/serve-healthcheck-canary/0.log" Jul 06 23:59:07.447632 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:07.447589 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-hlhtl_182215b6-8b23-4f4e-bb64-2302a1b08eae/kube-storage-version-migrator-operator/0.log" Jul 06 23:59:09.203559 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:09.203521 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:59:09.204047 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:09.203586 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:59:09.204114 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:09.204092 2549 scope.go:117] "RemoveContainer" containerID="2f3dd6099c2cdb2b7155b68e1b6213b4768403236c9ef785082bd217d7c0502e" Jul 06 23:59:09.204362 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:09.204335 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-kjfjg_openshift-console-operator(cd9d5c53-ba09-4586-a544-88ea6352bb0c)\"" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" podUID="cd9d5c53-ba09-4586-a544-88ea6352bb0c" Jul 06 23:59:09.780738 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:09.780704 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:09.780981 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:09.780895 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 23:59:09.781042 ip-10-0-142-126 kubenswrapper[2549]: E0706 23:59:09.780988 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls podName:be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c nodeName:}" failed. No retries permitted until 2026-07-06 23:59:17.780963924 +0000 UTC m=+65.211384669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6w7qf" (UID: "be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c") : secret "insights-runtime-extractor-tls" not found Jul 06 23:59:11.530078 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:11.530039 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" event={"ID":"935eb03a-7e2a-4e71-b8fe-6d10043454b6","Type":"ContainerStarted","Data":"262e3adb4ff2949b94cdbed07e3333ad2c8424e6678bab800fe88d25ffdab6a0"} Jul 06 23:59:11.530521 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:11.530213 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:59:11.531727 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:11.531706 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" Jul 06 23:59:11.548167 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:11.548122 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4bf7fb65-czdwm" podStartSLOduration=20.819968444 podStartE2EDuration="41.548109293s" totalImagesPullingTime="20.728140849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:11.546534395 +0000 UTC m=+58.976955156" watchObservedRunningTime="2026-07-06 23:59:11.548109293 +0000 UTC m=+58.978530054" Jul 06 23:59:14.383728 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:14.383693 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gqff" Jul 06 23:59:17.853880 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:17.853836 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:17.856160 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:17.856137 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6w7qf\" (UID: \"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c\") " pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:17.965635 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:17.965604 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6hpbz\"" Jul 06 23:59:17.974181 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:17.974147 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6w7qf" Jul 06 23:59:18.098814 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.098785 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6w7qf"] Jul 06 23:59:18.101673 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:59:18.101642 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe22bfbc_a0b7_441d_80e0_a13c5ca0dd3c.slice/crio-e0ee4e1e014bc70f7ad9fc3e7a1205dcbe84e1575e4f82fdf2a2fc06af16a309 WatchSource:0}: Error finding container e0ee4e1e014bc70f7ad9fc3e7a1205dcbe84e1575e4f82fdf2a2fc06af16a309: Status 404 returned error can't find the container with id e0ee4e1e014bc70f7ad9fc3e7a1205dcbe84e1575e4f82fdf2a2fc06af16a309 Jul 06 23:59:18.561626 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.561039 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6w7qf" event={"ID":"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c","Type":"ContainerStarted","Data":"e0ee4e1e014bc70f7ad9fc3e7a1205dcbe84e1575e4f82fdf2a2fc06af16a309"} Jul 06 23:59:18.761508 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.761041 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:59:18.763981 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.763801 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:59:18.779763 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.779709 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15ef6701-761f-4437-a24d-1f8cc1439acb-original-pull-secret\") pod \"global-pull-secret-syncer-wbbmh\" (UID: \"15ef6701-761f-4437-a24d-1f8cc1439acb\") " pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:59:18.861892 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.861602 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:59:18.864638 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.864610 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:59:18.875112 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.875052 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8505f9f-9105-4006-91d2-5455cfe622a6-metrics-certs\") pod \"network-metrics-daemon-w2rnb\" (UID: \"c8505f9f-9105-4006-91d2-5455cfe622a6\") " pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:59:18.914128 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.914070 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wbbmh" Jul 06 23:59:18.927036 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.926835 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6shd9\"" Jul 06 23:59:18.935809 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.935775 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2rnb" Jul 06 23:59:18.963368 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.963317 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n4m\" (UniqueName: \"kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m\") pod \"network-check-target-9tpzd\" (UID: \"199c3a86-2700-4cab-ad48-aec9e41cf843\") " pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:59:18.966412 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.966388 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:59:18.976874 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.976846 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:59:18.988783 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:18.988731 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8n4m\" (UniqueName: \"kubernetes.io/projected/199c3a86-2700-4cab-ad48-aec9e41cf843-kube-api-access-s8n4m\") pod \"network-check-target-9tpzd\" (UID: \"199c3a86-2700-4cab-ad48-aec9e41cf843\") " pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:59:19.094009 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:59:19.093957 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ef6701_761f_4437_a24d_1f8cc1439acb.slice/crio-ea02ce4a99fb814999207f78f5ecbf338619595d43fe89dd1a05dd163afa13aa WatchSource:0}: Error finding container ea02ce4a99fb814999207f78f5ecbf338619595d43fe89dd1a05dd163afa13aa: Status 404 returned error can't find the container with id ea02ce4a99fb814999207f78f5ecbf338619595d43fe89dd1a05dd163afa13aa Jul 06 23:59:19.094143 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:19.094038 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wbbmh"] Jul 06 23:59:19.123618 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:19.123535 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w2rnb"] Jul 06 23:59:19.126945 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:59:19.126914 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8505f9f_9105_4006_91d2_5455cfe622a6.slice/crio-9e0cbfc5faff136ae969bbd551d26ba79254181ad877a1150eb9e8991345e711 WatchSource:0}: Error finding container 9e0cbfc5faff136ae969bbd551d26ba79254181ad877a1150eb9e8991345e711: Status 404 returned error can't find the container with id 9e0cbfc5faff136ae969bbd551d26ba79254181ad877a1150eb9e8991345e711 Jul 06 23:59:19.223517 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:19.223492 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dn54q\"" Jul 06 23:59:19.230835 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:19.230811 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:59:19.376772 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:19.376656 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9tpzd"] Jul 06 23:59:19.379821 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:59:19.379792 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199c3a86_2700_4cab_ad48_aec9e41cf843.slice/crio-7bc61ae6d6b75fd54c1e4cdc6428213fa1600c0824095082c3c04e71641b8de0 WatchSource:0}: Error finding container 7bc61ae6d6b75fd54c1e4cdc6428213fa1600c0824095082c3c04e71641b8de0: Status 404 returned error can't find the container with id 7bc61ae6d6b75fd54c1e4cdc6428213fa1600c0824095082c3c04e71641b8de0 Jul 06 23:59:19.566415 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:19.566379 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9tpzd" event={"ID":"199c3a86-2700-4cab-ad48-aec9e41cf843","Type":"ContainerStarted","Data":"7bc61ae6d6b75fd54c1e4cdc6428213fa1600c0824095082c3c04e71641b8de0"} Jul 06 23:59:19.567948 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:19.567905 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w2rnb" event={"ID":"c8505f9f-9105-4006-91d2-5455cfe622a6","Type":"ContainerStarted","Data":"9e0cbfc5faff136ae969bbd551d26ba79254181ad877a1150eb9e8991345e711"} Jul 06 23:59:19.569483 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:19.569456 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wbbmh" event={"ID":"15ef6701-761f-4437-a24d-1f8cc1439acb","Type":"ContainerStarted","Data":"ea02ce4a99fb814999207f78f5ecbf338619595d43fe89dd1a05dd163afa13aa"} Jul 06 23:59:20.782080 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.782049 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:59:20.782503 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.782167 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:59:20.782503 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.782205 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:59:20.785152 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.785106 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e3706d-104f-4a61-96c9-f8e6ecb4e0b2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww9ms\" (UID: \"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:59:20.785152 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.785138 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") pod \"image-registry-774947cc59-8b9t8\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:59:20.785441 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.785196 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9deeccd6-365c-43a1-b6d9-d564a21cde0a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dtr5b\" (UID: \"9deeccd6-365c-43a1-b6d9-d564a21cde0a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:59:20.883123 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.883084 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:20.883336 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.883181 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:59:20.883336 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.883205 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:20.883984 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.883936 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996107f2-75f4-4da3-a4d0-5938ed1fc92e-service-ca-bundle\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:20.886307 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.886280 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/56c9a5c2-3cfd-4d15-a61a-9831990f5e1b-metrics-tls\") pod \"dns-default-4lc7t\" (UID: \"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b\") " pod="openshift-dns/dns-default-4lc7t" Jul 06 23:59:20.886517 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.886472 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996107f2-75f4-4da3-a4d0-5938ed1fc92e-metrics-certs\") pod \"router-default-6f986b9999-lj82p\" (UID: \"996107f2-75f4-4da3-a4d0-5938ed1fc92e\") " pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:20.965334 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.965292 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dzsxj\"" Jul 06 23:59:20.973308 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.973180 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:59:20.974914 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.974890 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-h4jss\"" Jul 06 23:59:20.982925 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:20.982869 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" Jul 06 23:59:21.019070 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:21.019048 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fxggh\"" Jul 06 23:59:21.026836 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:21.026779 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" Jul 06 23:59:21.072483 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:21.072414 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sczk5\"" Jul 06 23:59:21.080557 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:21.080524 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:21.104263 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:21.104237 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwk2d\"" Jul 06 23:59:21.112344 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:21.112323 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4lc7t" Jul 06 23:59:22.086298 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:22.086271 2549 scope.go:117] "RemoveContainer" containerID="2f3dd6099c2cdb2b7155b68e1b6213b4768403236c9ef785082bd217d7c0502e" Jul 06 23:59:24.538148 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:24.538118 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms"] Jul 06 23:59:25.583710 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.583648 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b"] Jul 06 23:59:25.596054 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:59:25.593584 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9deeccd6_365c_43a1_b6d9_d564a21cde0a.slice/crio-f68d826bb4507024ed0469d569b23a1afb3e2502da6f99f6db443816c8effed7 WatchSource:0}: Error finding container f68d826bb4507024ed0469d569b23a1afb3e2502da6f99f6db443816c8effed7: Status 404 returned error can't find the container with id f68d826bb4507024ed0469d569b23a1afb3e2502da6f99f6db443816c8effed7 Jul 06 23:59:25.601417 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.601386 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/1.log" Jul 06 23:59:25.601550 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.601527 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" event={"ID":"cd9d5c53-ba09-4586-a544-88ea6352bb0c","Type":"ContainerStarted","Data":"b50c13633c6819a7a8f39bad8523a88bd86487fce57830929a8705e80de2bb55"} Jul 06 23:59:25.602183 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.602025 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:59:25.606803 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.604154 2549 patch_prober.go:28] interesting pod/console-operator-68b757fb67-kjfjg container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body= Jul 06 23:59:25.606803 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.604206 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" podUID="cd9d5c53-ba09-4586-a544-88ea6352bb0c" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" Jul 06 23:59:25.608283 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.608253 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" event={"ID":"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2","Type":"ContainerStarted","Data":"99e2fd224fcf4ec89aecfa6377926654493cecc5c664878181ee0de370c4bfd8"} Jul 06 23:59:25.610451 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.610217 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6w7qf" event={"ID":"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c","Type":"ContainerStarted","Data":"2fe02c82ef459625d28885ff64b31c12472babdd3e882c077fd17238b5e45b57"} Jul 06 23:59:25.621685 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.621548 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" podStartSLOduration=29.955458971 podStartE2EDuration="39.621534884s" totalImagesPullingTime="9.666075913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:25.62141785 +0000 UTC m=+73.051838615" watchObservedRunningTime="2026-07-06 23:59:25.621534884 +0000 UTC m=+73.051955635" Jul 06 23:59:25.829392 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.829210 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4lc7t"] Jul 06 23:59:25.832484 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.832449 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-774947cc59-8b9t8"] Jul 06 23:59:25.832484 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:59:25.832472 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c9a5c2_3cfd_4d15_a61a_9831990f5e1b.slice/crio-7f3f39cab0090a30e8ae074794ed2ae8c59d4826eb84c710175d6a6e0d90c186 WatchSource:0}: Error finding container 7f3f39cab0090a30e8ae074794ed2ae8c59d4826eb84c710175d6a6e0d90c186: Status 404 returned error can't find the container with id 7f3f39cab0090a30e8ae074794ed2ae8c59d4826eb84c710175d6a6e0d90c186 Jul 06 23:59:25.833736 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:25.833700 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f986b9999-lj82p"] Jul 06 23:59:25.835476 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:59:25.835451 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a52377_d4a6_46ba_97f7_7c439d1cd40b.slice/crio-ce8798cf5dab70162afc7ae080df407a9e3362b6eb0bd32575dd4a38242e26c7 WatchSource:0}: Error finding container ce8798cf5dab70162afc7ae080df407a9e3362b6eb0bd32575dd4a38242e26c7: Status 404 returned error can't find the container with id ce8798cf5dab70162afc7ae080df407a9e3362b6eb0bd32575dd4a38242e26c7 Jul 06 23:59:25.836172 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:59:25.836107 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996107f2_75f4_4da3_a4d0_5938ed1fc92e.slice/crio-83184ab6dc3291bab5aca97672ac23c458292f4fcd065929f0ff0111175e39c4 WatchSource:0}: Error finding container 83184ab6dc3291bab5aca97672ac23c458292f4fcd065929f0ff0111175e39c4: Status 404 returned error can't find the container with id 83184ab6dc3291bab5aca97672ac23c458292f4fcd065929f0ff0111175e39c4 Jul 06 23:59:26.617753 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.617657 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wbbmh" event={"ID":"15ef6701-761f-4437-a24d-1f8cc1439acb","Type":"ContainerStarted","Data":"a5e6120b16d38e7b4ed0e6ee564e8c4483f4a017a9b372f09168d64fa14ed771"} Jul 06 23:59:26.619776 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.619746 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f986b9999-lj82p" event={"ID":"996107f2-75f4-4da3-a4d0-5938ed1fc92e","Type":"ContainerStarted","Data":"394ceccc860af4dc95cf7a6dc069bb2f58f9e7c3d1977a84ae45e03597432542"} Jul 06 23:59:26.619893 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.619796 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f986b9999-lj82p" event={"ID":"996107f2-75f4-4da3-a4d0-5938ed1fc92e","Type":"ContainerStarted","Data":"83184ab6dc3291bab5aca97672ac23c458292f4fcd065929f0ff0111175e39c4"} Jul 06 23:59:26.621735 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.621570 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9tpzd" event={"ID":"199c3a86-2700-4cab-ad48-aec9e41cf843","Type":"ContainerStarted","Data":"20b6148dfe9654c263f678142c7f7f5b9efa91048370c2d0cb4f3300f65f678e"} Jul 06 23:59:26.621735 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.621659 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 06 23:59:26.623449 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.623400 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4lc7t" event={"ID":"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b","Type":"ContainerStarted","Data":"7f3f39cab0090a30e8ae074794ed2ae8c59d4826eb84c710175d6a6e0d90c186"} Jul 06 23:59:26.625351 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.625315 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6w7qf" event={"ID":"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c","Type":"ContainerStarted","Data":"b72c139b222d7fedaeccb4e50831410d5c17687c0a1792de50b6360a9c556da5"} Jul 06 23:59:26.627608 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.627584 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w2rnb" event={"ID":"c8505f9f-9105-4006-91d2-5455cfe622a6","Type":"ContainerStarted","Data":"0870af80d0d4b2def609771ee72a625efb9f7c5867cd153b627c2330c38df423"} Jul 06 23:59:26.627720 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.627628 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w2rnb" event={"ID":"c8505f9f-9105-4006-91d2-5455cfe622a6","Type":"ContainerStarted","Data":"d37f02772acfdb3fb4c0cc2807c3a8f58cd79ce679fd8596eadd0213a9f16d4c"} Jul 06 23:59:26.629693 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.629579 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" event={"ID":"e4a52377-d4a6-46ba-97f7-7c439d1cd40b","Type":"ContainerStarted","Data":"c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee"} Jul 06 23:59:26.629693 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.629619 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" event={"ID":"e4a52377-d4a6-46ba-97f7-7c439d1cd40b","Type":"ContainerStarted","Data":"ce8798cf5dab70162afc7ae080df407a9e3362b6eb0bd32575dd4a38242e26c7"} Jul 06 23:59:26.629693 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.629669 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:59:26.630966 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.630937 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" event={"ID":"9deeccd6-365c-43a1-b6d9-d564a21cde0a","Type":"ContainerStarted","Data":"f68d826bb4507024ed0469d569b23a1afb3e2502da6f99f6db443816c8effed7"} Jul 06 23:59:26.636793 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.636736 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-kjfjg" Jul 06 23:59:26.636906 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.636857 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wbbmh" podStartSLOduration=67.361449541 podStartE2EDuration="1m13.636840504s" totalImagesPullingTime="6.275390963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:26.636386056 +0000 UTC m=+74.066806818" watchObservedRunningTime="2026-07-06 23:59:26.636840504 +0000 UTC m=+74.067261266" Jul 06 23:59:26.654892 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.654829 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9tpzd" podStartSLOduration=67.60453549 podStartE2EDuration="1m13.65481067s" totalImagesPullingTime="6.05027518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:26.653241477 +0000 UTC m=+74.083662241" watchObservedRunningTime="2026-07-06 23:59:26.65481067 +0000 UTC m=+74.085231432" Jul 06 23:59:26.672499 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.672445 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w2rnb" podStartSLOduration=67.432590163 podStartE2EDuration="1m13.67242411s" totalImagesPullingTime="6.239833947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:26.671423925 +0000 UTC m=+74.101844687" watchObservedRunningTime="2026-07-06 23:59:26.67242411 +0000 UTC m=+74.102844873" Jul 06 23:59:26.695190 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.695096 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" podStartSLOduration=73.695076806 podStartE2EDuration="1m13.695076806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:26.692785419 +0000 UTC m=+74.123206180" watchObservedRunningTime="2026-07-06 23:59:26.695076806 +0000 UTC m=+74.125497569" Jul 06 23:59:26.737461 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:26.737395 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f986b9999-lj82p" podStartSLOduration=45.73737406 podStartE2EDuration="45.73737406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:26.713504773 +0000 UTC m=+74.143925535" watchObservedRunningTime="2026-07-06 23:59:26.73737406 +0000 UTC m=+74.167794823" Jul 06 23:59:27.080842 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:27.080810 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:27.083618 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:27.083595 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:27.636632 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:27.636599 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:27.638100 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:27.637988 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f986b9999-lj82p" Jul 06 23:59:30.648150 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.648109 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6w7qf" event={"ID":"be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c","Type":"ContainerStarted","Data":"2aad6646769d2fe88219c68faaf741dbd9229db9d477c18107a7db1bfe4693e3"} Jul 06 23:59:30.649638 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.649614 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" event={"ID":"9deeccd6-365c-43a1-b6d9-d564a21cde0a","Type":"ContainerStarted","Data":"40ed3f9a6c25e7626d8cfa92c4a30e1371620cc596821ffcaeddd295206d14fe"} Jul 06 23:59:30.651370 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.651342 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" event={"ID":"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2","Type":"ContainerStarted","Data":"4cb6a18cc89872ad2f913813e85709cd9eed26974f3ff69f4d2937381ec862af"} Jul 06 23:59:30.651480 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.651387 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" event={"ID":"40e3706d-104f-4a61-96c9-f8e6ecb4e0b2","Type":"ContainerStarted","Data":"be3b8cab67a91b6b28d21a52604c26466af5ddde9fba8aba6284a1c18e02c9af"} Jul 06 23:59:30.653084 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.653066 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4lc7t" event={"ID":"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b","Type":"ContainerStarted","Data":"81979b700305d0cba8e373b6139e3fa81c183dc5af09c1b699bdc2528933fa1f"} Jul 06 23:59:30.653169 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.653101 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4lc7t" event={"ID":"56c9a5c2-3cfd-4d15-a61a-9831990f5e1b","Type":"ContainerStarted","Data":"1f389a27e2f050f6a97a927ba3ddac47fba0332cbfd9a8aa9c5b92a75036e348"} Jul 06 23:59:30.653216 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.653181 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4lc7t" Jul 06 23:59:30.670565 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.670526 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6w7qf" podStartSLOduration=17.114664929 podStartE2EDuration="28.670514655s" totalImagesPullingTime="11.555849726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:59:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:30.670445135 +0000 UTC m=+78.100865896" watchObservedRunningTime="2026-07-06 23:59:30.670514655 +0000 UTC m=+78.100935416" Jul 06 23:59:30.692557 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.692512 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4lc7t" podStartSLOduration=38.961794653 podStartE2EDuration="42.692499038s" totalImagesPullingTime="3.730704385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:30.691442648 +0000 UTC m=+78.121863420" watchObservedRunningTime="2026-07-06 23:59:30.692499038 +0000 UTC m=+78.122919798" Jul 06 23:59:30.709757 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.709715 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww9ms" podStartSLOduration=41.602673821 podStartE2EDuration="45.709701047s" totalImagesPullingTime="4.107027226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:30.708698843 +0000 UTC m=+78.139119603" watchObservedRunningTime="2026-07-06 23:59:30.709701047 +0000 UTC m=+78.140121807" Jul 06 23:59:30.735992 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:30.735944 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dtr5b" podStartSLOduration=45.767809718 podStartE2EDuration="49.735928423s" totalImagesPullingTime="3.968118705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:30.735872902 +0000 UTC m=+78.166293663" watchObservedRunningTime="2026-07-06 23:59:30.735928423 +0000 UTC m=+78.166349182" Jul 06 23:59:40.659878 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:40.659766 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4lc7t" Jul 06 23:59:41.780061 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.780021 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l7kqb"] Jul 06 23:59:41.809646 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.809612 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:41.813760 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.813732 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 23:59:41.813941 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.813893 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x6mqr\"" Jul 06 23:59:41.813941 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.813902 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 23:59:41.814053 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.814036 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 23:59:41.814783 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.814770 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 23:59:41.953635 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.953598 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r5w7\" (UniqueName: \"kubernetes.io/projected/73c01621-05ab-461c-8a25-3b2180010703-kube-api-access-4r5w7\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:41.953635 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.953641 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-textfile\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:41.953856 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.953659 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c01621-05ab-461c-8a25-3b2180010703-metrics-client-ca\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:41.953856 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.953733 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:41.953856 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.953770 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73c01621-05ab-461c-8a25-3b2180010703-root\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:41.953856 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.953791 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73c01621-05ab-461c-8a25-3b2180010703-sys\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:41.953856 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.953819 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:41.953856 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.953855 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-tls\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:41.954044 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:41.953878 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-wtmp\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055165 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055084 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r5w7\" (UniqueName: \"kubernetes.io/projected/73c01621-05ab-461c-8a25-3b2180010703-kube-api-access-4r5w7\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055165 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055138 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-textfile\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055398 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055163 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c01621-05ab-461c-8a25-3b2180010703-metrics-client-ca\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055398 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055203 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055398 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055249 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73c01621-05ab-461c-8a25-3b2180010703-root\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055398 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055273 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73c01621-05ab-461c-8a25-3b2180010703-sys\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055398 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055333 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73c01621-05ab-461c-8a25-3b2180010703-root\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055398 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055335 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73c01621-05ab-461c-8a25-3b2180010703-sys\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055398 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055382 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055754 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055413 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-tls\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055754 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055449 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-wtmp\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055754 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055553 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-textfile\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055754 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055655 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-wtmp\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055945 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055850 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.055945 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.055857 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c01621-05ab-461c-8a25-3b2180010703-metrics-client-ca\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.057710 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.057680 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.057798 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.057684 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73c01621-05ab-461c-8a25-3b2180010703-node-exporter-tls\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.063181 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.063159 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r5w7\" (UniqueName: \"kubernetes.io/projected/73c01621-05ab-461c-8a25-3b2180010703-kube-api-access-4r5w7\") pod \"node-exporter-l7kqb\" (UID: \"73c01621-05ab-461c-8a25-3b2180010703\") " pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.119540 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.119507 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l7kqb" Jul 06 23:59:42.150114 ip-10-0-142-126 kubenswrapper[2549]: W0706 23:59:42.150090 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c01621_05ab_461c_8a25_3b2180010703.slice/crio-c581d93b0dbc68b49a55bfd97c921d7f2ddf2f4be35ca4913ece0aa890ac03ba WatchSource:0}: Error finding container c581d93b0dbc68b49a55bfd97c921d7f2ddf2f4be35ca4913ece0aa890ac03ba: Status 404 returned error can't find the container with id c581d93b0dbc68b49a55bfd97c921d7f2ddf2f4be35ca4913ece0aa890ac03ba Jul 06 23:59:42.698121 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:42.698082 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7kqb" event={"ID":"73c01621-05ab-461c-8a25-3b2180010703","Type":"ContainerStarted","Data":"c581d93b0dbc68b49a55bfd97c921d7f2ddf2f4be35ca4913ece0aa890ac03ba"} Jul 06 23:59:43.703261 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:43.703213 2549 generic.go:356] "Generic (PLEG): container finished" podID="73c01621-05ab-461c-8a25-3b2180010703" containerID="d48237c7aabc1ee2efd0fbae8b6c4a79b5a18e02396a174431517da8f7147251" exitCode=0 Jul 06 23:59:43.703261 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:43.703251 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7kqb" event={"ID":"73c01621-05ab-461c-8a25-3b2180010703","Type":"ContainerDied","Data":"d48237c7aabc1ee2efd0fbae8b6c4a79b5a18e02396a174431517da8f7147251"} Jul 06 23:59:44.708650 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:44.708603 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7kqb" event={"ID":"73c01621-05ab-461c-8a25-3b2180010703","Type":"ContainerStarted","Data":"0a1f20e21e6e89b083971737b2387a4ec930e9eef46e1ad6ef120c068d4c5b13"} Jul 06 23:59:44.709131 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:44.708704 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7kqb" event={"ID":"73c01621-05ab-461c-8a25-3b2180010703","Type":"ContainerStarted","Data":"717d6bedeea4382e413ddad72f077f45f720941db5c6b8bad20660de534cc509"} Jul 06 23:59:44.732502 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:44.732449 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l7kqb" podStartSLOduration=2.7042036510000003 podStartE2EDuration="3.732432079s" totalImagesPullingTime="961.707088ms" totalInitContainerRuntime="66.52134ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:44.730639109 +0000 UTC m=+92.161059871" watchObservedRunningTime="2026-07-06 23:59:44.732432079 +0000 UTC m=+92.162852840" Jul 06 23:59:47.639796 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:47.639769 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 06 23:59:50.329484 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:50.329446 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-774947cc59-8b9t8"] Jul 06 23:59:57.638838 ip-10-0-142-126 kubenswrapper[2549]: I0706 23:59:57.638809 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9tpzd" Jul 07 00:00:06.788255 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:06.788146 2549 generic.go:356] "Generic (PLEG): container finished" podID="bc3cc7d0-0019-416b-8f66-ba6ebe388b25" containerID="6ffb21304edf08e7ec8440780229d89f23eb6f233c510d587d53483a00b74d12" exitCode=0 Jul 07 00:00:06.788633 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:06.788248 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" event={"ID":"bc3cc7d0-0019-416b-8f66-ba6ebe388b25","Type":"ContainerDied","Data":"6ffb21304edf08e7ec8440780229d89f23eb6f233c510d587d53483a00b74d12"} Jul 07 00:00:06.788633 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:06.788553 2549 scope.go:117] "RemoveContainer" containerID="6ffb21304edf08e7ec8440780229d89f23eb6f233c510d587d53483a00b74d12" Jul 07 00:00:07.793704 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:07.793673 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-dfq6l" event={"ID":"bc3cc7d0-0019-416b-8f66-ba6ebe388b25","Type":"ContainerStarted","Data":"f6f94aac50f17b882bfa1db44e8095769a6c1c5fcb5bafb440dcc6d38ba8b269"} Jul 07 00:00:11.809185 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:11.809150 2549 generic.go:356] "Generic (PLEG): container finished" podID="182215b6-8b23-4f4e-bb64-2302a1b08eae" containerID="c8f95007e8d6f7643e23c42411c7ac0baa801cd0b8c7b2ae295f183c08835b24" exitCode=0 Jul 07 00:00:11.809585 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:11.809206 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" event={"ID":"182215b6-8b23-4f4e-bb64-2302a1b08eae","Type":"ContainerDied","Data":"c8f95007e8d6f7643e23c42411c7ac0baa801cd0b8c7b2ae295f183c08835b24"} Jul 07 00:00:11.809585 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:11.809509 2549 scope.go:117] "RemoveContainer" containerID="c8f95007e8d6f7643e23c42411c7ac0baa801cd0b8c7b2ae295f183c08835b24" Jul 07 00:00:12.814676 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:12.814639 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hlhtl" event={"ID":"182215b6-8b23-4f4e-bb64-2302a1b08eae","Type":"ContainerStarted","Data":"9dbed24d1a423276cecb194139982350acaf03decef70ab69d200c10ff5415a2"} Jul 07 00:00:15.357931 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.357868 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" podUID="e4a52377-d4a6-46ba-97f7-7c439d1cd40b" containerName="registry" containerID="cri-o://c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee" gracePeriod=30 Jul 07 00:00:15.595698 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.595675 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 07 00:00:15.711677 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.711650 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-certificates\") pod \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " Jul 07 00:00:15.711882 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.711691 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-installation-pull-secrets\") pod \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " Jul 07 00:00:15.711882 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.711718 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-bound-sa-token\") pod \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " Jul 07 00:00:15.711882 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.711755 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") pod \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " Jul 07 00:00:15.711882 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.711787 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-image-registry-private-configuration\") pod \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " Jul 07 00:00:15.711882 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.711822 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-ca-trust-extracted\") pod \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " Jul 07 00:00:15.711882 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.711849 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fblsd\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-kube-api-access-fblsd\") pod \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " Jul 07 00:00:15.711882 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.711877 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-trusted-ca\") pod \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\" (UID: \"e4a52377-d4a6-46ba-97f7-7c439d1cd40b\") " Jul 07 00:00:15.712423 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.712397 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e4a52377-d4a6-46ba-97f7-7c439d1cd40b" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:15.712575 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.712463 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e4a52377-d4a6-46ba-97f7-7c439d1cd40b" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:15.714189 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.714163 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e4a52377-d4a6-46ba-97f7-7c439d1cd40b" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:00:15.714359 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.714318 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e4a52377-d4a6-46ba-97f7-7c439d1cd40b" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:00:15.714437 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.714356 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e4a52377-d4a6-46ba-97f7-7c439d1cd40b" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:15.714510 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.714486 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e4a52377-d4a6-46ba-97f7-7c439d1cd40b" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:15.714588 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.714565 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-kube-api-access-fblsd" (OuterVolumeSpecName: "kube-api-access-fblsd") pod "e4a52377-d4a6-46ba-97f7-7c439d1cd40b" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b"). InnerVolumeSpecName "kube-api-access-fblsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:15.720508 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.720484 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e4a52377-d4a6-46ba-97f7-7c439d1cd40b" (UID: "e4a52377-d4a6-46ba-97f7-7c439d1cd40b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:00:15.812969 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.812935 2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-image-registry-private-configuration\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:00:15.812969 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.812963 2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-ca-trust-extracted\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:00:15.812969 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.812973 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fblsd\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-kube-api-access-fblsd\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:00:15.813154 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.812983 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-trusted-ca\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:00:15.813154 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.812991 2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-certificates\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:00:15.813154 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.813000 2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-installation-pull-secrets\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:00:15.813154 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.813007 2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-bound-sa-token\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:00:15.813154 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.813015 2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4a52377-d4a6-46ba-97f7-7c439d1cd40b-registry-tls\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:00:15.826953 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.826925 2549 generic.go:356] "Generic (PLEG): container finished" podID="e4a52377-d4a6-46ba-97f7-7c439d1cd40b" containerID="c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee" exitCode=0 Jul 07 00:00:15.827038 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.826970 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" Jul 07 00:00:15.827038 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.827014 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" event={"ID":"e4a52377-d4a6-46ba-97f7-7c439d1cd40b","Type":"ContainerDied","Data":"c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee"} Jul 07 00:00:15.827119 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.827061 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774947cc59-8b9t8" event={"ID":"e4a52377-d4a6-46ba-97f7-7c439d1cd40b","Type":"ContainerDied","Data":"ce8798cf5dab70162afc7ae080df407a9e3362b6eb0bd32575dd4a38242e26c7"} Jul 07 00:00:15.827119 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.827082 2549 scope.go:117] "RemoveContainer" containerID="c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee" Jul 07 00:00:15.836428 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.836411 2549 scope.go:117] "RemoveContainer" containerID="c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee" Jul 07 00:00:15.836692 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:00:15.836671 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee\": container with ID starting with c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee not found: ID does not exist" containerID="c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee" Jul 07 00:00:15.836758 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.836703 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee"} err="failed to get container status \"c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee\": rpc error: code = NotFound desc = could not find container \"c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee\": container with ID starting with c59fc5983057362407f059dac6ee03049ed2902d93039303e99b1e5329f04fee not found: ID does not exist" Jul 07 00:00:15.847775 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.847751 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-774947cc59-8b9t8"] Jul 07 00:00:15.851798 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:15.851778 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-774947cc59-8b9t8"] Jul 07 00:00:16.832919 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:16.832888 2549 generic.go:356] "Generic (PLEG): container finished" podID="5635d7b0-c65d-47a3-9b86-ca1a0f059d25" containerID="34c8aaa886340bfeadebcc7c0cb54a703afd21392e2d738e36aaea4ae9b1d335" exitCode=0 Jul 07 00:00:16.833323 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:16.832935 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" event={"ID":"5635d7b0-c65d-47a3-9b86-ca1a0f059d25","Type":"ContainerDied","Data":"34c8aaa886340bfeadebcc7c0cb54a703afd21392e2d738e36aaea4ae9b1d335"} Jul 07 00:00:16.833323 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:16.833283 2549 scope.go:117] "RemoveContainer" containerID="34c8aaa886340bfeadebcc7c0cb54a703afd21392e2d738e36aaea4ae9b1d335" Jul 07 00:00:17.090533 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:17.090442 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4a52377-d4a6-46ba-97f7-7c439d1cd40b" path="/var/lib/kubelet/pods/e4a52377-d4a6-46ba-97f7-7c439d1cd40b/volumes" Jul 07 00:00:17.838579 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:17.838545 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-fpxq2" event={"ID":"5635d7b0-c65d-47a3-9b86-ca1a0f059d25","Type":"ContainerStarted","Data":"1d0175de0855b0a6e7ad05eec98efaa89c69d14bc68f86f24608df1d44efdb62"} Jul 07 00:00:29.278238 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:29.278191 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" podUID="994bf19b-30bc-495b-9c52-31c1cf0ae962" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 07 00:00:39.277869 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:39.277831 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" podUID="994bf19b-30bc-495b-9c52-31c1cf0ae962" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 07 00:00:49.278498 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:49.278457 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" podUID="994bf19b-30bc-495b-9c52-31c1cf0ae962" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 07 00:00:49.278985 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:49.278526 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" Jul 07 00:00:49.279127 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:49.279105 2549 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"1fa2bce85cf3079995c1bdef3a675d2eb2bd83132d97bc5eb3aade79f7d52762"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 07 00:00:49.279189 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:49.279156 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" podUID="994bf19b-30bc-495b-9c52-31c1cf0ae962" containerName="service-proxy" containerID="cri-o://1fa2bce85cf3079995c1bdef3a675d2eb2bd83132d97bc5eb3aade79f7d52762" gracePeriod=30 Jul 07 00:00:49.960558 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:49.960523 2549 generic.go:356] "Generic (PLEG): container finished" podID="994bf19b-30bc-495b-9c52-31c1cf0ae962" containerID="1fa2bce85cf3079995c1bdef3a675d2eb2bd83132d97bc5eb3aade79f7d52762" exitCode=2 Jul 07 00:00:49.960721 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:49.960583 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" event={"ID":"994bf19b-30bc-495b-9c52-31c1cf0ae962","Type":"ContainerDied","Data":"1fa2bce85cf3079995c1bdef3a675d2eb2bd83132d97bc5eb3aade79f7d52762"} Jul 07 00:00:49.960721 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:00:49.960626 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b599c8f4-cbrxl" event={"ID":"994bf19b-30bc-495b-9c52-31c1cf0ae962","Type":"ContainerStarted","Data":"6b7323f01310fa786ead255a9fc531abf9531a3019e23f522527d8e55af927a6"} Jul 07 00:03:12.990726 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:03:12.990700 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/1.log" Jul 07 00:03:12.995956 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:03:12.995935 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/1.log" Jul 07 00:03:12.997024 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:03:12.997003 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gqff_b09bd804-568b-4f7e-9621-e1bd704362d7/ovn-acl-logging/0.log" Jul 07 00:03:13.002703 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:03:13.002687 2549 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 00:03:13.002789 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:03:13.002719 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gqff_b09bd804-568b-4f7e-9621-e1bd704362d7/ovn-acl-logging/0.log" Jul 07 00:04:02.614576 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.614538 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr"] Jul 07 00:04:02.614990 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.614799 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4a52377-d4a6-46ba-97f7-7c439d1cd40b" containerName="registry" Jul 07 00:04:02.614990 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.614809 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4a52377-d4a6-46ba-97f7-7c439d1cd40b" containerName="registry" Jul 07 00:04:02.614990 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.614868 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4a52377-d4a6-46ba-97f7-7c439d1cd40b" containerName="registry" Jul 07 00:04:02.616703 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.616689 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.617942 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.617920 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.618046 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.617960 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-manifests\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.618046 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.617978 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxw7m\" (UniqueName: \"kubernetes.io/projected/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-kube-api-access-vxw7m\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.618150 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.618058 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-tmp\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.618150 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.618103 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.619762 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.619746 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 00:04:02.621324 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.621308 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 00:04:02.621663 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.621647 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 00:04:02.621764 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.621750 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kqkjk\"" Jul 07 00:04:02.625565 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.625548 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 00:04:02.645027 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.644995 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr"] Jul 07 00:04:02.718588 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.718559 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-tmp\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.718769 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.718599 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.718769 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.718624 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.718769 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.718649 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-manifests\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.718769 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.718665 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxw7m\" (UniqueName: \"kubernetes.io/projected/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-kube-api-access-vxw7m\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.719057 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.719035 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-manifests\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.721044 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.721023 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-tmp\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.721160 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.721080 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.721219 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.721163 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.728539 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.728513 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxw7m\" (UniqueName: \"kubernetes.io/projected/fab64746-9bce-44c3-b5fe-74ca0ddeeb7e-kube-api-access-vxw7m\") pod \"opendatahub-operator-controller-manager-5b6fc95b89-t9pnr\" (UID: \"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:02.927442 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:02.927328 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:03.060767 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:03.060743 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr"] Jul 07 00:04:03.063624 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:04:03.063594 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab64746_9bce_44c3_b5fe_74ca0ddeeb7e.slice/crio-28ce5ab89ca8eb74e0167c12ea7da8d2b350da6dc867892e2043b18bf440d1be WatchSource:0}: Error finding container 28ce5ab89ca8eb74e0167c12ea7da8d2b350da6dc867892e2043b18bf440d1be: Status 404 returned error can't find the container with id 28ce5ab89ca8eb74e0167c12ea7da8d2b350da6dc867892e2043b18bf440d1be Jul 07 00:04:03.065591 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:03.065575 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:04:03.641697 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:03.641665 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" event={"ID":"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e","Type":"ContainerStarted","Data":"28ce5ab89ca8eb74e0167c12ea7da8d2b350da6dc867892e2043b18bf440d1be"} Jul 07 00:04:06.658076 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:06.658043 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" event={"ID":"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e","Type":"ContainerStarted","Data":"0a138d76d4cf018e7fd47a5f446b8c476cc552d3cf00e1198ed70e9fce17cdca"} Jul 07 00:04:07.662943 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:07.662858 2549 generic.go:356] "Generic (PLEG): container finished" podID="fab64746-9bce-44c3-b5fe-74ca0ddeeb7e" containerID="0a138d76d4cf018e7fd47a5f446b8c476cc552d3cf00e1198ed70e9fce17cdca" exitCode=0 Jul 07 00:04:07.662943 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:07.662905 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" event={"ID":"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e","Type":"ContainerDied","Data":"0a138d76d4cf018e7fd47a5f446b8c476cc552d3cf00e1198ed70e9fce17cdca"} Jul 07 00:04:08.668997 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:08.668956 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" event={"ID":"fab64746-9bce-44c3-b5fe-74ca0ddeeb7e","Type":"ContainerStarted","Data":"5aff0e27030b2c25550f0cc575aba2cbe77082416657d1be193d372f2b888bc1"} Jul 07 00:04:08.669515 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:08.669073 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:08.696422 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:08.696361 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" podStartSLOduration=2.141413977 podStartE2EDuration="6.696345819s" totalImagesPullingTime="3.506022282s" totalInitContainerRuntime="1.04890956s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:08.694920295 +0000 UTC m=+356.125341057" watchObservedRunningTime="2026-07-07 00:04:08.696345819 +0000 UTC m=+356.126766580" Jul 07 00:04:19.674742 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:19.674709 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b6fc95b89-t9pnr" Jul 07 00:04:23.572193 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.572158 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x"] Jul 07 00:04:23.588003 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.587972 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:23.588637 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.588597 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x"] Jul 07 00:04:23.590634 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.590603 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 00:04:23.590768 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.590655 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bg6ds\"" Jul 07 00:04:23.590768 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.590680 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 00:04:23.681781 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.681750 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc7efb58-c8f6-4064-b71a-ce5c1ecfa397-tls-certs\") pod \"kube-auth-proxy-7f8d95c48d-jl22x\" (UID: \"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397\") " pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:23.681941 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.681788 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc7efb58-c8f6-4064-b71a-ce5c1ecfa397-tmp\") pod \"kube-auth-proxy-7f8d95c48d-jl22x\" (UID: \"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397\") " pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:23.681941 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.681873 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76bvz\" (UniqueName: \"kubernetes.io/projected/dc7efb58-c8f6-4064-b71a-ce5c1ecfa397-kube-api-access-76bvz\") pod \"kube-auth-proxy-7f8d95c48d-jl22x\" (UID: \"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397\") " pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:23.720459 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.720426 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-snjdj"] Jul 07 00:04:23.723523 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.723506 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:23.726813 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.726789 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5gqf4\"" Jul 07 00:04:23.726951 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.726874 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 00:04:23.740950 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.740923 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-snjdj"] Jul 07 00:04:23.782540 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.782508 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9-cert\") pod \"odh-model-controller-7998c67dc4-snjdj\" (UID: \"f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9\") " pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:23.782721 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.782570 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc7efb58-c8f6-4064-b71a-ce5c1ecfa397-tls-certs\") pod \"kube-auth-proxy-7f8d95c48d-jl22x\" (UID: \"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397\") " pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:23.782721 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.782670 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpjlb\" (UniqueName: \"kubernetes.io/projected/f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9-kube-api-access-wpjlb\") pod \"odh-model-controller-7998c67dc4-snjdj\" (UID: \"f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9\") " pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:23.782839 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.782727 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc7efb58-c8f6-4064-b71a-ce5c1ecfa397-tmp\") pod \"kube-auth-proxy-7f8d95c48d-jl22x\" (UID: \"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397\") " pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:23.782839 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.782818 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76bvz\" (UniqueName: \"kubernetes.io/projected/dc7efb58-c8f6-4064-b71a-ce5c1ecfa397-kube-api-access-76bvz\") pod \"kube-auth-proxy-7f8d95c48d-jl22x\" (UID: \"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397\") " pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:23.785051 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.785022 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc7efb58-c8f6-4064-b71a-ce5c1ecfa397-tmp\") pod \"kube-auth-proxy-7f8d95c48d-jl22x\" (UID: \"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397\") " pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:23.785615 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.785592 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc7efb58-c8f6-4064-b71a-ce5c1ecfa397-tls-certs\") pod \"kube-auth-proxy-7f8d95c48d-jl22x\" (UID: \"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397\") " pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:23.797486 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.797460 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76bvz\" (UniqueName: \"kubernetes.io/projected/dc7efb58-c8f6-4064-b71a-ce5c1ecfa397-kube-api-access-76bvz\") pod \"kube-auth-proxy-7f8d95c48d-jl22x\" (UID: \"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397\") " pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:23.884048 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.883907 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9-cert\") pod \"odh-model-controller-7998c67dc4-snjdj\" (UID: \"f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9\") " pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:23.884048 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:04:23.884020 2549 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 07 00:04:23.884048 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.884049 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjlb\" (UniqueName: \"kubernetes.io/projected/f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9-kube-api-access-wpjlb\") pod \"odh-model-controller-7998c67dc4-snjdj\" (UID: \"f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9\") " pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:23.884354 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:04:23.884090 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9-cert podName:f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9 nodeName:}" failed. No retries permitted until 2026-07-07 00:04:24.384068615 +0000 UTC m=+371.814489374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9-cert") pod "odh-model-controller-7998c67dc4-snjdj" (UID: "f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9") : secret "odh-model-controller-webhook-cert" not found Jul 07 00:04:23.896085 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.896058 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpjlb\" (UniqueName: \"kubernetes.io/projected/f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9-kube-api-access-wpjlb\") pod \"odh-model-controller-7998c67dc4-snjdj\" (UID: \"f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9\") " pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:23.898788 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:23.898769 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" Jul 07 00:04:24.043465 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.043446 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x"] Jul 07 00:04:24.045741 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:04:24.045714 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7efb58_c8f6_4064_b71a_ce5c1ecfa397.slice/crio-953b6b91118542976479f0cae7184fd0cfd38d91e1eaaafcbc162cd6f28dba6c WatchSource:0}: Error finding container 953b6b91118542976479f0cae7184fd0cfd38d91e1eaaafcbc162cd6f28dba6c: Status 404 returned error can't find the container with id 953b6b91118542976479f0cae7184fd0cfd38d91e1eaaafcbc162cd6f28dba6c Jul 07 00:04:24.387286 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.387248 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9-cert\") pod \"odh-model-controller-7998c67dc4-snjdj\" (UID: \"f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9\") " pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:24.389812 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.389775 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9-cert\") pod \"odh-model-controller-7998c67dc4-snjdj\" (UID: \"f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9\") " pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:24.635755 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.635710 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:24.646563 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.646534 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dlmfl"] Jul 07 00:04:24.649652 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.649633 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:24.652461 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.652440 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 00:04:24.652935 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.652919 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-zcvn4\"" Jul 07 00:04:24.671192 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.671156 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dlmfl"] Jul 07 00:04:24.691417 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.691257 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-tls-certs\") pod \"model-serving-api-54d89bd5fc-dlmfl\" (UID: \"55e45361-24b9-4b6b-b1cb-1cf9e2d58545\") " pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:24.691417 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.691314 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sqv4\" (UniqueName: \"kubernetes.io/projected/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-kube-api-access-6sqv4\") pod \"model-serving-api-54d89bd5fc-dlmfl\" (UID: \"55e45361-24b9-4b6b-b1cb-1cf9e2d58545\") " pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:24.735896 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.735859 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" event={"ID":"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397","Type":"ContainerStarted","Data":"953b6b91118542976479f0cae7184fd0cfd38d91e1eaaafcbc162cd6f28dba6c"} Jul 07 00:04:24.792541 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.792111 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-tls-certs\") pod \"model-serving-api-54d89bd5fc-dlmfl\" (UID: \"55e45361-24b9-4b6b-b1cb-1cf9e2d58545\") " pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:24.792541 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.792158 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sqv4\" (UniqueName: \"kubernetes.io/projected/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-kube-api-access-6sqv4\") pod \"model-serving-api-54d89bd5fc-dlmfl\" (UID: \"55e45361-24b9-4b6b-b1cb-1cf9e2d58545\") " pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:24.792541 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:04:24.792308 2549 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 07 00:04:24.792541 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:04:24.792412 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-tls-certs podName:55e45361-24b9-4b6b-b1cb-1cf9e2d58545 nodeName:}" failed. No retries permitted until 2026-07-07 00:04:25.292371407 +0000 UTC m=+372.722792156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-tls-certs") pod "model-serving-api-54d89bd5fc-dlmfl" (UID: "55e45361-24b9-4b6b-b1cb-1cf9e2d58545") : secret "model-serving-api-tls" not found Jul 07 00:04:24.796727 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.796695 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-snjdj"] Jul 07 00:04:24.806564 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:24.806535 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sqv4\" (UniqueName: \"kubernetes.io/projected/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-kube-api-access-6sqv4\") pod \"model-serving-api-54d89bd5fc-dlmfl\" (UID: \"55e45361-24b9-4b6b-b1cb-1cf9e2d58545\") " pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:24.807326 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:04:24.806917 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9dd76d3_a0e4_4d38_b47d_de1dfc72a4b9.slice/crio-0fb3fd87805455afc9275f7c530d510e75a26af544b42726c56fedf31b1bb571 WatchSource:0}: Error finding container 0fb3fd87805455afc9275f7c530d510e75a26af544b42726c56fedf31b1bb571: Status 404 returned error can't find the container with id 0fb3fd87805455afc9275f7c530d510e75a26af544b42726c56fedf31b1bb571 Jul 07 00:04:25.047355 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.047316 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf"] Jul 07 00:04:25.051243 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.051202 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.068693 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.068655 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 00:04:25.068693 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.068655 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 00:04:25.068936 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.068832 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 00:04:25.069000 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.068982 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 00:04:25.069126 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.069108 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c7v96\"" Jul 07 00:04:25.095112 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.095076 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.095307 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.095124 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.095307 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.095157 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-cacerts\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.095307 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.095193 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.095307 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.095261 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-token\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.095307 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.095285 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rzp\" (UniqueName: \"kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-kube-api-access-f4rzp\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.095544 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.095315 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16962e81-100d-4b09-b93a-e0afc28f57d1-local-certs\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.096813 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.096789 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf"] Jul 07 00:04:25.196077 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.196043 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-cacerts\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.196276 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.196086 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.196276 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.196112 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-token\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.196276 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.196133 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rzp\" (UniqueName: \"kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-kube-api-access-f4rzp\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.196276 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.196162 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16962e81-100d-4b09-b93a-e0afc28f57d1-local-certs\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.196493 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.196303 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.196493 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.196335 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.196875 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.196844 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.198711 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.198678 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16962e81-100d-4b09-b93a-e0afc28f57d1-local-certs\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.198816 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.198761 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.199056 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.199035 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.199674 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.199655 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-cacerts\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.204408 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.204384 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rzp\" (UniqueName: \"kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-kube-api-access-f4rzp\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.209392 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.209369 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-token\") pod \"istiod-openshift-gateway-7574459656-6qgxf\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.296837 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.296790 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-tls-certs\") pod \"model-serving-api-54d89bd5fc-dlmfl\" (UID: \"55e45361-24b9-4b6b-b1cb-1cf9e2d58545\") " pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:25.297029 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:04:25.296987 2549 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 07 00:04:25.297095 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:04:25.297049 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-tls-certs podName:55e45361-24b9-4b6b-b1cb-1cf9e2d58545 nodeName:}" failed. No retries permitted until 2026-07-07 00:04:26.297034675 +0000 UTC m=+373.727455418 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-tls-certs") pod "model-serving-api-54d89bd5fc-dlmfl" (UID: "55e45361-24b9-4b6b-b1cb-1cf9e2d58545") : secret "model-serving-api-tls" not found Jul 07 00:04:25.363140 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.363046 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:25.550799 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.550770 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf"] Jul 07 00:04:25.554170 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:04:25.554136 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16962e81_100d_4b09_b93a_e0afc28f57d1.slice/crio-93e2735279fca3f97eda52b2bb01dc7b04037ccc3eebed01ebafd697d187cd68 WatchSource:0}: Error finding container 93e2735279fca3f97eda52b2bb01dc7b04037ccc3eebed01ebafd697d187cd68: Status 404 returned error can't find the container with id 93e2735279fca3f97eda52b2bb01dc7b04037ccc3eebed01ebafd697d187cd68 Jul 07 00:04:25.743688 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.743619 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" event={"ID":"16962e81-100d-4b09-b93a-e0afc28f57d1","Type":"ContainerStarted","Data":"93e2735279fca3f97eda52b2bb01dc7b04037ccc3eebed01ebafd697d187cd68"} Jul 07 00:04:25.745300 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:25.745211 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" event={"ID":"f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9","Type":"ContainerStarted","Data":"0fb3fd87805455afc9275f7c530d510e75a26af544b42726c56fedf31b1bb571"} Jul 07 00:04:26.306918 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:26.306881 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-tls-certs\") pod \"model-serving-api-54d89bd5fc-dlmfl\" (UID: \"55e45361-24b9-4b6b-b1cb-1cf9e2d58545\") " pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:26.313255 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:26.313169 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e45361-24b9-4b6b-b1cb-1cf9e2d58545-tls-certs\") pod \"model-serving-api-54d89bd5fc-dlmfl\" (UID: \"55e45361-24b9-4b6b-b1cb-1cf9e2d58545\") " pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:26.462338 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:26.462297 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:28.261593 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:28.261562 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dlmfl"] Jul 07 00:04:28.264305 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:04:28.264087 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e45361_24b9_4b6b_b1cb_1cf9e2d58545.slice/crio-6a6f3897ca94d997435edc2d4cfe0c44d20c581ccb207f5d366e3c18b3318e2a WatchSource:0}: Error finding container 6a6f3897ca94d997435edc2d4cfe0c44d20c581ccb207f5d366e3c18b3318e2a: Status 404 returned error can't find the container with id 6a6f3897ca94d997435edc2d4cfe0c44d20c581ccb207f5d366e3c18b3318e2a Jul 07 00:04:28.765047 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:28.764537 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" event={"ID":"f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9","Type":"ContainerStarted","Data":"9ddaa50257129c33f544a71b5749dc0ed7b797b93161c67f084df609e0fb0a68"} Jul 07 00:04:28.765047 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:28.764811 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:28.766897 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:28.766839 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" event={"ID":"55e45361-24b9-4b6b-b1cb-1cf9e2d58545","Type":"ContainerStarted","Data":"6a6f3897ca94d997435edc2d4cfe0c44d20c581ccb207f5d366e3c18b3318e2a"} Jul 07 00:04:28.771008 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:28.770717 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" event={"ID":"dc7efb58-c8f6-4064-b71a-ce5c1ecfa397","Type":"ContainerStarted","Data":"6d9d7835b26108d0bd29d8c80306be623ce9655a6c46a97a97c4844929fd1eb0"} Jul 07 00:04:28.789613 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:28.789481 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" podStartSLOduration=2.453490513 podStartE2EDuration="5.789407169s" totalImagesPullingTime="3.335916656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:28.785485513 +0000 UTC m=+376.215906273" watchObservedRunningTime="2026-07-07 00:04:28.789407169 +0000 UTC m=+376.219827931" Jul 07 00:04:28.805882 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:28.805801 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f8d95c48d-jl22x" podStartSLOduration=1.752679104 podStartE2EDuration="5.805778333s" totalImagesPullingTime="4.053099229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:28.804683857 +0000 UTC m=+376.235104621" watchObservedRunningTime="2026-07-07 00:04:28.805778333 +0000 UTC m=+376.236199099" Jul 07 00:04:30.502783 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:30.502738 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:04:30.503098 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:30.502822 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 00:04:30.783749 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:30.783660 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" event={"ID":"16962e81-100d-4b09-b93a-e0afc28f57d1","Type":"ContainerStarted","Data":"ddd5e69e12dadaad69209f5ea8ab8cfd27f38f7382aa50303c65f14c001d4e34"} Jul 07 00:04:30.783749 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:30.783738 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:30.785394 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:30.785363 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" event={"ID":"55e45361-24b9-4b6b-b1cb-1cf9e2d58545","Type":"ContainerStarted","Data":"20631232cc65acc8baaddfe2826bbb7eb682ee04516bfb8f08427ead0e546a85"} Jul 07 00:04:30.785515 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:30.785418 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:04:30.805095 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:30.805038 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" podStartSLOduration=0.861275894 podStartE2EDuration="5.805018529s" totalImagesPullingTime="4.943742635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:30.803705754 +0000 UTC m=+378.234126516" watchObservedRunningTime="2026-07-07 00:04:30.805018529 +0000 UTC m=+378.235439290" Jul 07 00:04:30.821549 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:30.821501 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" podStartSLOduration=4.585163819 podStartE2EDuration="6.821485746s" totalImagesPullingTime="2.236321927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:30.820105414 +0000 UTC m=+378.250526178" watchObservedRunningTime="2026-07-07 00:04:30.821485746 +0000 UTC m=+378.251906507" Jul 07 00:04:31.792038 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:31.792011 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:35.911422 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:35.911383 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4gm76"] Jul 07 00:04:35.914344 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:35.914328 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" Jul 07 00:04:35.918361 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:35.918329 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7jgkd\"" Jul 07 00:04:35.919276 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:35.919253 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 00:04:35.920789 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:35.920769 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs"] Jul 07 00:04:35.924172 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:35.924154 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" Jul 07 00:04:35.930308 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:35.930288 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 00:04:35.930413 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:35.930361 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5lstp\"" Jul 07 00:04:35.930538 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:35.930513 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4gm76"] Jul 07 00:04:35.937062 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:35.937038 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs"] Jul 07 00:04:36.001197 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.001166 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08066484-309d-4671-87f0-19b4efc3fb22-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n2fcs\" (UID: \"08066484-309d-4671-87f0-19b4efc3fb22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" Jul 07 00:04:36.001393 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.001246 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/137e129f-78a4-4b3d-a66c-0c4a6a8be3a2-cert\") pod \"kserve-controller-manager-d6f4b65b8-4gm76\" (UID: \"137e129f-78a4-4b3d-a66c-0c4a6a8be3a2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" Jul 07 00:04:36.001393 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.001269 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhq67\" (UniqueName: \"kubernetes.io/projected/137e129f-78a4-4b3d-a66c-0c4a6a8be3a2-kube-api-access-nhq67\") pod \"kserve-controller-manager-d6f4b65b8-4gm76\" (UID: \"137e129f-78a4-4b3d-a66c-0c4a6a8be3a2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" Jul 07 00:04:36.001393 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.001303 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9gmp\" (UniqueName: \"kubernetes.io/projected/08066484-309d-4671-87f0-19b4efc3fb22-kube-api-access-j9gmp\") pod \"llmisvc-controller-manager-777c6bd7d5-n2fcs\" (UID: \"08066484-309d-4671-87f0-19b4efc3fb22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" Jul 07 00:04:36.102355 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.102321 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/137e129f-78a4-4b3d-a66c-0c4a6a8be3a2-cert\") pod \"kserve-controller-manager-d6f4b65b8-4gm76\" (UID: \"137e129f-78a4-4b3d-a66c-0c4a6a8be3a2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" Jul 07 00:04:36.102355 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.102356 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhq67\" (UniqueName: \"kubernetes.io/projected/137e129f-78a4-4b3d-a66c-0c4a6a8be3a2-kube-api-access-nhq67\") pod \"kserve-controller-manager-d6f4b65b8-4gm76\" (UID: \"137e129f-78a4-4b3d-a66c-0c4a6a8be3a2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" Jul 07 00:04:36.102562 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.102449 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9gmp\" (UniqueName: \"kubernetes.io/projected/08066484-309d-4671-87f0-19b4efc3fb22-kube-api-access-j9gmp\") pod \"llmisvc-controller-manager-777c6bd7d5-n2fcs\" (UID: \"08066484-309d-4671-87f0-19b4efc3fb22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" Jul 07 00:04:36.102562 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.102538 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08066484-309d-4671-87f0-19b4efc3fb22-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n2fcs\" (UID: \"08066484-309d-4671-87f0-19b4efc3fb22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" Jul 07 00:04:36.104974 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.104949 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08066484-309d-4671-87f0-19b4efc3fb22-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n2fcs\" (UID: \"08066484-309d-4671-87f0-19b4efc3fb22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" Jul 07 00:04:36.105109 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.104977 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/137e129f-78a4-4b3d-a66c-0c4a6a8be3a2-cert\") pod \"kserve-controller-manager-d6f4b65b8-4gm76\" (UID: \"137e129f-78a4-4b3d-a66c-0c4a6a8be3a2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" Jul 07 00:04:36.115875 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.115847 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhq67\" (UniqueName: \"kubernetes.io/projected/137e129f-78a4-4b3d-a66c-0c4a6a8be3a2-kube-api-access-nhq67\") pod \"kserve-controller-manager-d6f4b65b8-4gm76\" (UID: \"137e129f-78a4-4b3d-a66c-0c4a6a8be3a2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" Jul 07 00:04:36.116282 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.116263 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9gmp\" (UniqueName: \"kubernetes.io/projected/08066484-309d-4671-87f0-19b4efc3fb22-kube-api-access-j9gmp\") pod \"llmisvc-controller-manager-777c6bd7d5-n2fcs\" (UID: \"08066484-309d-4671-87f0-19b4efc3fb22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" Jul 07 00:04:36.225392 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.225355 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" Jul 07 00:04:36.233604 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.233582 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" Jul 07 00:04:36.380218 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.380188 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4gm76"] Jul 07 00:04:36.383122 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:04:36.383097 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137e129f_78a4_4b3d_a66c_0c4a6a8be3a2.slice/crio-339edc8ada976b5b0af1515375fb6246da59555571b7302d293013c6828af6fc WatchSource:0}: Error finding container 339edc8ada976b5b0af1515375fb6246da59555571b7302d293013c6828af6fc: Status 404 returned error can't find the container with id 339edc8ada976b5b0af1515375fb6246da59555571b7302d293013c6828af6fc Jul 07 00:04:36.431124 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.431101 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs"] Jul 07 00:04:36.433150 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:04:36.433112 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod08066484_309d_4671_87f0_19b4efc3fb22.slice/crio-1635ebdf137f2f998858fa70f8bafdf3eda5250fee0d615419d8df7e7c6af45f WatchSource:0}: Error finding container 1635ebdf137f2f998858fa70f8bafdf3eda5250fee0d615419d8df7e7c6af45f: Status 404 returned error can't find the container with id 1635ebdf137f2f998858fa70f8bafdf3eda5250fee0d615419d8df7e7c6af45f Jul 07 00:04:36.814978 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.814936 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" event={"ID":"137e129f-78a4-4b3d-a66c-0c4a6a8be3a2","Type":"ContainerStarted","Data":"339edc8ada976b5b0af1515375fb6246da59555571b7302d293013c6828af6fc"} Jul 07 00:04:36.816188 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:36.816162 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" event={"ID":"08066484-309d-4671-87f0-19b4efc3fb22","Type":"ContainerStarted","Data":"1635ebdf137f2f998858fa70f8bafdf3eda5250fee0d615419d8df7e7c6af45f"} Jul 07 00:04:37.673456 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:37.673419 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf"] Jul 07 00:04:37.674006 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:37.673839 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" podUID="16962e81-100d-4b09-b93a-e0afc28f57d1" containerName="discovery" containerID="cri-o://ddd5e69e12dadaad69209f5ea8ab8cfd27f38f7382aa50303c65f14c001d4e34" gracePeriod=30 Jul 07 00:04:37.791073 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:37.791045 2549 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-6qgxf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.25:8080/ready\": dial tcp 10.132.0.25:8080: connect: connection refused" start-of-body= Jul 07 00:04:37.791138 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:37.791118 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" podUID="16962e81-100d-4b09-b93a-e0afc28f57d1" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.25:8080/ready\": dial tcp 10.132.0.25:8080: connect: connection refused" Jul 07 00:04:37.822652 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:37.822622 2549 generic.go:356] "Generic (PLEG): container finished" podID="16962e81-100d-4b09-b93a-e0afc28f57d1" containerID="ddd5e69e12dadaad69209f5ea8ab8cfd27f38f7382aa50303c65f14c001d4e34" exitCode=0 Jul 07 00:04:37.822652 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:37.822663 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" event={"ID":"16962e81-100d-4b09-b93a-e0afc28f57d1","Type":"ContainerDied","Data":"ddd5e69e12dadaad69209f5ea8ab8cfd27f38f7382aa50303c65f14c001d4e34"} Jul 07 00:04:37.946626 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:37.946598 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:38.019915 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.019880 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-token\") pod \"16962e81-100d-4b09-b93a-e0afc28f57d1\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " Jul 07 00:04:38.020106 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.019946 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4rzp\" (UniqueName: \"kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-kube-api-access-f4rzp\") pod \"16962e81-100d-4b09-b93a-e0afc28f57d1\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " Jul 07 00:04:38.020106 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.019991 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-kubeconfig\") pod \"16962e81-100d-4b09-b93a-e0afc28f57d1\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " Jul 07 00:04:38.020106 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.020037 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16962e81-100d-4b09-b93a-e0afc28f57d1-local-certs\") pod \"16962e81-100d-4b09-b93a-e0afc28f57d1\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " Jul 07 00:04:38.020106 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.020079 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-dns-cert\") pod \"16962e81-100d-4b09-b93a-e0afc28f57d1\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " Jul 07 00:04:38.020357 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.020110 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-cacerts\") pod \"16962e81-100d-4b09-b93a-e0afc28f57d1\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " Jul 07 00:04:38.020357 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.020134 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-ca-configmap\") pod \"16962e81-100d-4b09-b93a-e0afc28f57d1\" (UID: \"16962e81-100d-4b09-b93a-e0afc28f57d1\") " Jul 07 00:04:38.020750 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.020719 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "16962e81-100d-4b09-b93a-e0afc28f57d1" (UID: "16962e81-100d-4b09-b93a-e0afc28f57d1"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:04:38.022965 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.022939 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "16962e81-100d-4b09-b93a-e0afc28f57d1" (UID: "16962e81-100d-4b09-b93a-e0afc28f57d1"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:04:38.023071 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.022959 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-kube-api-access-f4rzp" (OuterVolumeSpecName: "kube-api-access-f4rzp") pod "16962e81-100d-4b09-b93a-e0afc28f57d1" (UID: "16962e81-100d-4b09-b93a-e0afc28f57d1"). InnerVolumeSpecName "kube-api-access-f4rzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:04:38.023071 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.023042 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "16962e81-100d-4b09-b93a-e0afc28f57d1" (UID: "16962e81-100d-4b09-b93a-e0afc28f57d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:04:38.023558 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.023526 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "16962e81-100d-4b09-b93a-e0afc28f57d1" (UID: "16962e81-100d-4b09-b93a-e0afc28f57d1"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:04:38.023649 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.023597 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-cacerts" (OuterVolumeSpecName: "cacerts") pod "16962e81-100d-4b09-b93a-e0afc28f57d1" (UID: "16962e81-100d-4b09-b93a-e0afc28f57d1"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:04:38.023698 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.023641 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16962e81-100d-4b09-b93a-e0afc28f57d1-local-certs" (OuterVolumeSpecName: "local-certs") pod "16962e81-100d-4b09-b93a-e0afc28f57d1" (UID: "16962e81-100d-4b09-b93a-e0afc28f57d1"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:04:38.120803 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.120759 2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-token\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:04:38.120803 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.120792 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4rzp\" (UniqueName: \"kubernetes.io/projected/16962e81-100d-4b09-b93a-e0afc28f57d1-kube-api-access-f4rzp\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:04:38.121009 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.120809 2549 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-kubeconfig\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:04:38.121009 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.120822 2549 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16962e81-100d-4b09-b93a-e0afc28f57d1-local-certs\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:04:38.121009 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.120831 2549 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-dns-cert\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:04:38.121009 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.120839 2549 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16962e81-100d-4b09-b93a-e0afc28f57d1-cacerts\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:04:38.121009 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.120850 2549 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16962e81-100d-4b09-b93a-e0afc28f57d1-istio-csr-ca-configmap\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:04:38.833088 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.833061 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" Jul 07 00:04:38.833563 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.833098 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf" event={"ID":"16962e81-100d-4b09-b93a-e0afc28f57d1","Type":"ContainerDied","Data":"93e2735279fca3f97eda52b2bb01dc7b04037ccc3eebed01ebafd697d187cd68"} Jul 07 00:04:38.833563 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.833153 2549 scope.go:117] "RemoveContainer" containerID="ddd5e69e12dadaad69209f5ea8ab8cfd27f38f7382aa50303c65f14c001d4e34" Jul 07 00:04:38.862245 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.862192 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf"] Jul 07 00:04:38.874341 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:38.874310 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6qgxf"] Jul 07 00:04:39.092209 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:39.092133 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16962e81-100d-4b09-b93a-e0afc28f57d1" path="/var/lib/kubelet/pods/16962e81-100d-4b09-b93a-e0afc28f57d1/volumes" Jul 07 00:04:39.779180 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:39.779148 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-snjdj" Jul 07 00:04:40.845576 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:40.845540 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" event={"ID":"137e129f-78a4-4b3d-a66c-0c4a6a8be3a2","Type":"ContainerStarted","Data":"ef248c9d616b53e2bf2b417eb87041722339c59da3f57e330ff74fa35e35b1ed"} Jul 07 00:04:40.845977 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:40.845608 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" Jul 07 00:04:40.847130 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:40.847100 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" event={"ID":"08066484-309d-4671-87f0-19b4efc3fb22","Type":"ContainerStarted","Data":"93f76bfc9de8b67f15efbab9080c222587db4d0fa7c3caa839a5a1616e63c28a"} Jul 07 00:04:40.847266 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:40.847178 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" Jul 07 00:04:40.862775 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:40.862731 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" podStartSLOduration=2.145476063 podStartE2EDuration="5.862717398s" totalImagesPullingTime="3.717241335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:40.862359356 +0000 UTC m=+388.292780119" watchObservedRunningTime="2026-07-07 00:04:40.862717398 +0000 UTC m=+388.293138159" Jul 07 00:04:40.879944 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:40.879896 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" podStartSLOduration=2.214835022 podStartE2EDuration="5.879881864s" totalImagesPullingTime="3.665046842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:40.877889818 +0000 UTC m=+388.308310574" watchObservedRunningTime="2026-07-07 00:04:40.879881864 +0000 UTC m=+388.310302626" Jul 07 00:04:41.794429 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:04:41.794382 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-dlmfl" Jul 07 00:05:11.853384 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:11.853348 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n2fcs" Jul 07 00:05:11.856312 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:11.856295 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4gm76" Jul 07 00:05:24.574611 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.574575 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bzsl"] Jul 07 00:05:24.575046 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.574880 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16962e81-100d-4b09-b93a-e0afc28f57d1" containerName="discovery" Jul 07 00:05:24.575046 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.574891 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="16962e81-100d-4b09-b93a-e0afc28f57d1" containerName="discovery" Jul 07 00:05:24.575046 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.574946 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="16962e81-100d-4b09-b93a-e0afc28f57d1" containerName="discovery" Jul 07 00:05:24.577313 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.577297 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" Jul 07 00:05:24.581068 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.580852 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-7qpqc\"" Jul 07 00:05:24.581372 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.581348 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 00:05:24.581540 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.581516 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 00:05:24.588797 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.588773 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bzsl"] Jul 07 00:05:24.704567 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.704542 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vscl\" (UniqueName: \"kubernetes.io/projected/09650cf0-7ea3-411a-8b13-9b6cdeaca23b-kube-api-access-2vscl\") pod \"kuadrant-operator-catalog-5bzsl\" (UID: \"09650cf0-7ea3-411a-8b13-9b6cdeaca23b\") " pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" Jul 07 00:05:24.805661 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.805623 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vscl\" (UniqueName: \"kubernetes.io/projected/09650cf0-7ea3-411a-8b13-9b6cdeaca23b-kube-api-access-2vscl\") pod \"kuadrant-operator-catalog-5bzsl\" (UID: \"09650cf0-7ea3-411a-8b13-9b6cdeaca23b\") " pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" Jul 07 00:05:24.814946 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.814915 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vscl\" (UniqueName: \"kubernetes.io/projected/09650cf0-7ea3-411a-8b13-9b6cdeaca23b-kube-api-access-2vscl\") pod \"kuadrant-operator-catalog-5bzsl\" (UID: \"09650cf0-7ea3-411a-8b13-9b6cdeaca23b\") " pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" Jul 07 00:05:24.887879 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.887801 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" Jul 07 00:05:24.906018 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:24.905980 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bzsl"] Jul 07 00:05:25.012313 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:25.012279 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bzsl"] Jul 07 00:05:25.014908 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:05:25.014875 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09650cf0_7ea3_411a_8b13_9b6cdeaca23b.slice/crio-4df70f2a0366b1d17689eef2a125c8579e8174fde377ae4a88a2c5ce1e2f4dc0 WatchSource:0}: Error finding container 4df70f2a0366b1d17689eef2a125c8579e8174fde377ae4a88a2c5ce1e2f4dc0: Status 404 returned error can't find the container with id 4df70f2a0366b1d17689eef2a125c8579e8174fde377ae4a88a2c5ce1e2f4dc0 Jul 07 00:05:25.031332 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:25.031306 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" event={"ID":"09650cf0-7ea3-411a-8b13-9b6cdeaca23b","Type":"ContainerStarted","Data":"4df70f2a0366b1d17689eef2a125c8579e8174fde377ae4a88a2c5ce1e2f4dc0"} Jul 07 00:05:25.116064 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:25.116035 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lw5qr"] Jul 07 00:05:25.118443 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:25.118429 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" Jul 07 00:05:25.127547 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:25.127526 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lw5qr"] Jul 07 00:05:25.208291 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:25.208258 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h44zg\" (UniqueName: \"kubernetes.io/projected/d3b0f479-1e7c-4b38-b044-d5194b7a4a2a-kube-api-access-h44zg\") pod \"kuadrant-operator-catalog-lw5qr\" (UID: \"d3b0f479-1e7c-4b38-b044-d5194b7a4a2a\") " pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" Jul 07 00:05:25.309275 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:25.309248 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44zg\" (UniqueName: \"kubernetes.io/projected/d3b0f479-1e7c-4b38-b044-d5194b7a4a2a-kube-api-access-h44zg\") pod \"kuadrant-operator-catalog-lw5qr\" (UID: \"d3b0f479-1e7c-4b38-b044-d5194b7a4a2a\") " pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" Jul 07 00:05:25.319109 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:25.319073 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h44zg\" (UniqueName: \"kubernetes.io/projected/d3b0f479-1e7c-4b38-b044-d5194b7a4a2a-kube-api-access-h44zg\") pod \"kuadrant-operator-catalog-lw5qr\" (UID: \"d3b0f479-1e7c-4b38-b044-d5194b7a4a2a\") " pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" Jul 07 00:05:25.428166 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:25.428137 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" Jul 07 00:05:25.578435 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:25.578379 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lw5qr"] Jul 07 00:05:25.580837 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:05:25.580795 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b0f479_1e7c_4b38_b044_d5194b7a4a2a.slice/crio-9cd9931cd98f3ab63dc83728818e076d2d14e63687db7faf4c75e44dad60786c WatchSource:0}: Error finding container 9cd9931cd98f3ab63dc83728818e076d2d14e63687db7faf4c75e44dad60786c: Status 404 returned error can't find the container with id 9cd9931cd98f3ab63dc83728818e076d2d14e63687db7faf4c75e44dad60786c Jul 07 00:05:26.037878 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:26.037848 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" event={"ID":"d3b0f479-1e7c-4b38-b044-d5194b7a4a2a","Type":"ContainerStarted","Data":"9cd9931cd98f3ab63dc83728818e076d2d14e63687db7faf4c75e44dad60786c"} Jul 07 00:05:27.045856 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:27.045820 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" event={"ID":"d3b0f479-1e7c-4b38-b044-d5194b7a4a2a","Type":"ContainerStarted","Data":"5a8b5a337805ee22a2fc52cf12506d89f3389dee700e59fe43ada2c83ff7c66f"} Jul 07 00:05:27.047463 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:27.047437 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" event={"ID":"09650cf0-7ea3-411a-8b13-9b6cdeaca23b","Type":"ContainerStarted","Data":"60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b"} Jul 07 00:05:27.047580 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:27.047495 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" podUID="09650cf0-7ea3-411a-8b13-9b6cdeaca23b" containerName="registry-server" containerID="cri-o://60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b" gracePeriod=2 Jul 07 00:05:27.062776 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:27.061847 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" podStartSLOduration=0.739605808 podStartE2EDuration="2.061833036s" totalImagesPullingTime="1.322227228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:27.060931448 +0000 UTC m=+434.491352210" watchObservedRunningTime="2026-07-07 00:05:27.061833036 +0000 UTC m=+434.492253798" Jul 07 00:05:27.076820 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:27.076773 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" podStartSLOduration=1.191289421 podStartE2EDuration="3.076758305s" totalImagesPullingTime="1.885468884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:27.076189319 +0000 UTC m=+434.506610079" watchObservedRunningTime="2026-07-07 00:05:27.076758305 +0000 UTC m=+434.507179065" Jul 07 00:05:27.282996 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:27.282974 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5bzsl_09650cf0-7ea3-411a-8b13-9b6cdeaca23b/registry-server/0.log" Jul 07 00:05:27.284270 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:27.284256 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" Jul 07 00:05:27.426812 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:27.426731 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vscl\" (UniqueName: \"kubernetes.io/projected/09650cf0-7ea3-411a-8b13-9b6cdeaca23b-kube-api-access-2vscl\") pod \"09650cf0-7ea3-411a-8b13-9b6cdeaca23b\" (UID: \"09650cf0-7ea3-411a-8b13-9b6cdeaca23b\") " Jul 07 00:05:27.428842 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:27.428812 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09650cf0-7ea3-411a-8b13-9b6cdeaca23b-kube-api-access-2vscl" (OuterVolumeSpecName: "kube-api-access-2vscl") pod "09650cf0-7ea3-411a-8b13-9b6cdeaca23b" (UID: "09650cf0-7ea3-411a-8b13-9b6cdeaca23b"). InnerVolumeSpecName "kube-api-access-2vscl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:05:27.527911 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:27.527875 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vscl\" (UniqueName: \"kubernetes.io/projected/09650cf0-7ea3-411a-8b13-9b6cdeaca23b-kube-api-access-2vscl\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:05:28.053057 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:28.053032 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5bzsl_09650cf0-7ea3-411a-8b13-9b6cdeaca23b/registry-server/0.log" Jul 07 00:05:28.053504 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:28.053068 2549 generic.go:356] "Generic (PLEG): container finished" podID="09650cf0-7ea3-411a-8b13-9b6cdeaca23b" containerID="60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b" exitCode=1 Jul 07 00:05:28.053504 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:28.053120 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" Jul 07 00:05:28.053504 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:28.053173 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" event={"ID":"09650cf0-7ea3-411a-8b13-9b6cdeaca23b","Type":"ContainerDied","Data":"60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b"} Jul 07 00:05:28.053504 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:28.053253 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5bzsl" event={"ID":"09650cf0-7ea3-411a-8b13-9b6cdeaca23b","Type":"ContainerDied","Data":"4df70f2a0366b1d17689eef2a125c8579e8174fde377ae4a88a2c5ce1e2f4dc0"} Jul 07 00:05:28.053504 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:28.053285 2549 scope.go:117] "RemoveContainer" containerID="60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b" Jul 07 00:05:28.062574 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:28.062559 2549 scope.go:117] "RemoveContainer" containerID="60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b" Jul 07 00:05:28.062804 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:05:28.062786 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b\": container with ID starting with 60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b not found: ID does not exist" containerID="60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b" Jul 07 00:05:28.062844 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:28.062811 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b"} err="failed to get container status \"60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b\": rpc error: code = NotFound desc = could not find container \"60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b\": container with ID starting with 60e1615825c98c991858bd7e1553fe0634086dfbd6ace020f1e29d53c8d81f7b not found: ID does not exist" Jul 07 00:05:28.074574 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:28.074554 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bzsl"] Jul 07 00:05:28.079350 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:28.079331 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bzsl"] Jul 07 00:05:29.090975 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:29.090944 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09650cf0-7ea3-411a-8b13-9b6cdeaca23b" path="/var/lib/kubelet/pods/09650cf0-7ea3-411a-8b13-9b6cdeaca23b/volumes" Jul 07 00:05:35.429200 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:35.429113 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" Jul 07 00:05:35.429200 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:35.429176 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" Jul 07 00:05:35.452467 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:35.452442 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" Jul 07 00:05:36.107282 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:36.107258 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lw5qr" Jul 07 00:05:57.169250 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.169206 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl"] Jul 07 00:05:57.169708 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.169537 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09650cf0-7ea3-411a-8b13-9b6cdeaca23b" containerName="registry-server" Jul 07 00:05:57.169708 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.169549 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="09650cf0-7ea3-411a-8b13-9b6cdeaca23b" containerName="registry-server" Jul 07 00:05:57.169708 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.169618 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="09650cf0-7ea3-411a-8b13-9b6cdeaca23b" containerName="registry-server" Jul 07 00:05:57.172338 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.172323 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:05:57.174885 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.174863 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lnvhx\"" Jul 07 00:05:57.182983 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.182962 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl"] Jul 07 00:05:57.260989 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.260959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crg6r\" (UniqueName: \"kubernetes.io/projected/afc6be3f-d6ea-482c-82cc-7d35119f20a3-kube-api-access-crg6r\") pod \"limitador-operator-controller-manager-859d7b78bd-n9xhl\" (UID: \"afc6be3f-d6ea-482c-82cc-7d35119f20a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:05:57.361428 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.361395 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crg6r\" (UniqueName: \"kubernetes.io/projected/afc6be3f-d6ea-482c-82cc-7d35119f20a3-kube-api-access-crg6r\") pod \"limitador-operator-controller-manager-859d7b78bd-n9xhl\" (UID: \"afc6be3f-d6ea-482c-82cc-7d35119f20a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:05:57.371591 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.371567 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crg6r\" (UniqueName: \"kubernetes.io/projected/afc6be3f-d6ea-482c-82cc-7d35119f20a3-kube-api-access-crg6r\") pod \"limitador-operator-controller-manager-859d7b78bd-n9xhl\" (UID: \"afc6be3f-d6ea-482c-82cc-7d35119f20a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:05:57.483040 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.483009 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:05:57.639562 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:57.639540 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl"] Jul 07 00:05:57.641400 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:05:57.641374 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc6be3f_d6ea_482c_82cc_7d35119f20a3.slice/crio-d92e02314d77778f6935e65965c004bab55ebb027f5efcf062e83d387f13b9db WatchSource:0}: Error finding container d92e02314d77778f6935e65965c004bab55ebb027f5efcf062e83d387f13b9db: Status 404 returned error can't find the container with id d92e02314d77778f6935e65965c004bab55ebb027f5efcf062e83d387f13b9db Jul 07 00:05:58.185931 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:05:58.185898 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" event={"ID":"afc6be3f-d6ea-482c-82cc-7d35119f20a3","Type":"ContainerStarted","Data":"d92e02314d77778f6935e65965c004bab55ebb027f5efcf062e83d387f13b9db"} Jul 07 00:06:00.195237 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:00.195201 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" event={"ID":"afc6be3f-d6ea-482c-82cc-7d35119f20a3","Type":"ContainerStarted","Data":"5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d"} Jul 07 00:06:00.195583 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:00.195350 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:00.216234 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:00.216179 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" podStartSLOduration=1.117495741 podStartE2EDuration="3.216165495s" totalImagesPullingTime="2.098669754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:00.215412384 +0000 UTC m=+467.645833144" watchObservedRunningTime="2026-07-07 00:06:00.216165495 +0000 UTC m=+467.646586254" Jul 07 00:06:02.360456 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.360418 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp"] Jul 07 00:06:02.363944 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.363920 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:02.366457 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.366439 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qw9z2\"" Jul 07 00:06:02.376280 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.376254 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp"] Jul 07 00:06:02.397717 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.397689 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfq8w\" (UniqueName: \"kubernetes.io/projected/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-kube-api-access-sfq8w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" (UID: \"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:02.397850 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.397732 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" (UID: \"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:02.498413 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.498382 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" (UID: \"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:02.498592 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.498477 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfq8w\" (UniqueName: \"kubernetes.io/projected/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-kube-api-access-sfq8w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" (UID: \"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:02.498877 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.498852 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" (UID: \"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:02.511789 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.511762 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfq8w\" (UniqueName: \"kubernetes.io/projected/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-kube-api-access-sfq8w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" (UID: \"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:02.674717 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.674633 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:02.808547 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:02.808520 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp"] Jul 07 00:06:02.814449 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:06:02.814425 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94cbc1fc_3273_4d60_8ba1_dd38fdf80f28.slice/crio-fa725558b2120fc1fcd22edfd587e41427d74572d8b68f1b1dfcafe3156ca53e WatchSource:0}: Error finding container fa725558b2120fc1fcd22edfd587e41427d74572d8b68f1b1dfcafe3156ca53e: Status 404 returned error can't find the container with id fa725558b2120fc1fcd22edfd587e41427d74572d8b68f1b1dfcafe3156ca53e Jul 07 00:06:03.208521 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:03.208485 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" event={"ID":"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28","Type":"ContainerStarted","Data":"fa725558b2120fc1fcd22edfd587e41427d74572d8b68f1b1dfcafe3156ca53e"} Jul 07 00:06:04.774940 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:04.774908 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd"] Jul 07 00:06:04.778096 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:04.778082 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd" Jul 07 00:06:04.780837 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:04.780821 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cnc6r\"" Jul 07 00:06:04.792190 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:04.792171 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd"] Jul 07 00:06:04.815790 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:04.815768 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb79p\" (UniqueName: \"kubernetes.io/projected/6363df97-6632-49ee-97e0-21e510e479d7-kube-api-access-jb79p\") pod \"authorino-operator-75cc8d5cb7-wvmjd\" (UID: \"6363df97-6632-49ee-97e0-21e510e479d7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd" Jul 07 00:06:04.917183 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:04.917150 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb79p\" (UniqueName: \"kubernetes.io/projected/6363df97-6632-49ee-97e0-21e510e479d7-kube-api-access-jb79p\") pod \"authorino-operator-75cc8d5cb7-wvmjd\" (UID: \"6363df97-6632-49ee-97e0-21e510e479d7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd" Jul 07 00:06:04.929494 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:04.929467 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb79p\" (UniqueName: \"kubernetes.io/projected/6363df97-6632-49ee-97e0-21e510e479d7-kube-api-access-jb79p\") pod \"authorino-operator-75cc8d5cb7-wvmjd\" (UID: \"6363df97-6632-49ee-97e0-21e510e479d7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd" Jul 07 00:06:05.088147 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:05.088058 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd" Jul 07 00:06:05.218374 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:05.218348 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd"] Jul 07 00:06:05.220335 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:06:05.220311 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6363df97_6632_49ee_97e0_21e510e479d7.slice/crio-5025bb166a54b250b29c70327de99bc0a1f6466f89f87cedca4291e1ab5875b9 WatchSource:0}: Error finding container 5025bb166a54b250b29c70327de99bc0a1f6466f89f87cedca4291e1ab5875b9: Status 404 returned error can't find the container with id 5025bb166a54b250b29c70327de99bc0a1f6466f89f87cedca4291e1ab5875b9 Jul 07 00:06:06.226355 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:06.226316 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd" event={"ID":"6363df97-6632-49ee-97e0-21e510e479d7","Type":"ContainerStarted","Data":"5025bb166a54b250b29c70327de99bc0a1f6466f89f87cedca4291e1ab5875b9"} Jul 07 00:06:09.244159 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:09.244122 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd" event={"ID":"6363df97-6632-49ee-97e0-21e510e479d7","Type":"ContainerStarted","Data":"ee8bf710bd734c6171ac1e34c7bba551bf8281e9f4e7afc4682d7ce6e679b292"} Jul 07 00:06:09.244626 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:09.244193 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd" Jul 07 00:06:09.245799 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:09.245778 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" event={"ID":"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28","Type":"ContainerStarted","Data":"481b466e7eb1506ca79186a419f5ecf8472c8edd7f6a24f2bd8847787e1453a3"} Jul 07 00:06:09.245919 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:09.245904 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:09.268410 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:09.268367 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd" podStartSLOduration=2.050281882 podStartE2EDuration="5.268351344s" totalImagesPullingTime="3.218069462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:09.267356419 +0000 UTC m=+476.697777180" watchObservedRunningTime="2026-07-07 00:06:09.268351344 +0000 UTC m=+476.698772103" Jul 07 00:06:09.285867 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:09.285817 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" podStartSLOduration=1.6979672209999999 podStartE2EDuration="7.285800898s" totalImagesPullingTime="5.587833677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:09.285301051 +0000 UTC m=+476.715721812" watchObservedRunningTime="2026-07-07 00:06:09.285800898 +0000 UTC m=+476.716221712" Jul 07 00:06:11.202429 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:11.202401 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:20.253503 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:20.253466 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:20.253922 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:20.253626 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wvmjd" Jul 07 00:06:21.927257 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:21.924743 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx"] Jul 07 00:06:21.930884 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:21.930855 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:21.939724 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:21.939703 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx"] Jul 07 00:06:22.023381 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.023346 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx"] Jul 07 00:06:22.023595 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.023577 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-c2jt2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" podUID="29b8fe8f-018a-4853-a401-85af9df3ee27" Jul 07 00:06:22.065564 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.065536 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m"] Jul 07 00:06:22.069180 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.069163 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.071936 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.071909 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29b8fe8f-018a-4853-a401-85af9df3ee27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" (UID: \"29b8fe8f-018a-4853-a401-85af9df3ee27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.072060 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.071965 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2jt2\" (UniqueName: \"kubernetes.io/projected/29b8fe8f-018a-4853-a401-85af9df3ee27-kube-api-access-c2jt2\") pod \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" (UID: \"29b8fe8f-018a-4853-a401-85af9df3ee27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.081838 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.081817 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m"] Jul 07 00:06:22.141954 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.141921 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx"] Jul 07 00:06:22.147581 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.147559 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx"] Jul 07 00:06:22.158484 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.158464 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp"] Jul 07 00:06:22.158666 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.158630 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" containerName="manager" containerID="cri-o://481b466e7eb1506ca79186a419f5ecf8472c8edd7f6a24f2bd8847787e1453a3" gracePeriod=2 Jul 07 00:06:22.166604 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.166582 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp"] Jul 07 00:06:22.172389 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.172352 2549 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\": pods \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:22.172609 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.172582 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2jt2\" (UniqueName: \"kubernetes.io/projected/29b8fe8f-018a-4853-a401-85af9df3ee27-kube-api-access-c2jt2\") pod \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" (UID: \"29b8fe8f-018a-4853-a401-85af9df3ee27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.172923 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.172714 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1963c8d8-3cc7-4d67-bec5-8438979b8123-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-msd7m\" (UID: \"1963c8d8-3cc7-4d67-bec5-8438979b8123\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.172923 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.172825 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29b8fe8f-018a-4853-a401-85af9df3ee27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" (UID: \"29b8fe8f-018a-4853-a401-85af9df3ee27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.172923 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.172910 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q28gx\" (UniqueName: \"kubernetes.io/projected/1963c8d8-3cc7-4d67-bec5-8438979b8123-kube-api-access-q28gx\") pod \"kuadrant-operator-controller-manager-86878c769f-msd7m\" (UID: \"1963c8d8-3cc7-4d67-bec5-8438979b8123\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.173637 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.173616 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29b8fe8f-018a-4853-a401-85af9df3ee27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" (UID: \"29b8fe8f-018a-4853-a401-85af9df3ee27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.179632 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.179613 2549 projected.go:196] Error preparing data for projected volume kube-api-access-c2jt2 for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-vj7fx" not found Jul 07 00:06:22.179733 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.179683 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b8fe8f-018a-4853-a401-85af9df3ee27-kube-api-access-c2jt2 podName:29b8fe8f-018a-4853-a401-85af9df3ee27 nodeName:}" failed. No retries permitted until 2026-07-07 00:06:22.679661415 +0000 UTC m=+490.110082154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c2jt2" (UniqueName: "kubernetes.io/projected/29b8fe8f-018a-4853-a401-85af9df3ee27-kube-api-access-c2jt2") pod "kuadrant-operator-controller-manager-55467d9f7-vj7fx" (UID: "29b8fe8f-018a-4853-a401-85af9df3ee27") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-vj7fx" not found Jul 07 00:06:22.181729 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.181707 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m"] Jul 07 00:06:22.181945 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.181928 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-q28gx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" podUID="1963c8d8-3cc7-4d67-bec5-8438979b8123" Jul 07 00:06:22.197930 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.197906 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf"] Jul 07 00:06:22.198433 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.198411 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" containerName="manager" Jul 07 00:06:22.198433 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.198434 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" containerName="manager" Jul 07 00:06:22.198591 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.198525 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" containerName="manager" Jul 07 00:06:22.201660 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.201644 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m"] Jul 07 00:06:22.201726 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.201720 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:22.218081 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.218054 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf"] Jul 07 00:06:22.219643 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.219601 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl"] Jul 07 00:06:22.219823 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.219789 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" containerName="manager" containerID="cri-o://5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d" gracePeriod=2 Jul 07 00:06:22.220999 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.220972 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9"] Jul 07 00:06:22.224538 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.224517 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" Jul 07 00:06:22.234258 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.234208 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl"] Jul 07 00:06:22.237846 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.237827 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9"] Jul 07 00:06:22.243383 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.243357 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:22.245810 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.245786 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9xhl\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:22.272857 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.272826 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:22.273858 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.273831 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1963c8d8-3cc7-4d67-bec5-8438979b8123-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-msd7m\" (UID: \"1963c8d8-3cc7-4d67-bec5-8438979b8123\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.273963 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.273926 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q28gx\" (UniqueName: \"kubernetes.io/projected/1963c8d8-3cc7-4d67-bec5-8438979b8123-kube-api-access-q28gx\") pod \"kuadrant-operator-controller-manager-86878c769f-msd7m\" (UID: \"1963c8d8-3cc7-4d67-bec5-8438979b8123\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.273963 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.273953 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/393ee73e-a704-4980-8d05-f749c56ef09d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmxsf\" (UID: \"393ee73e-a704-4980-8d05-f749c56ef09d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:22.274091 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.273995 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd7r7\" (UniqueName: \"kubernetes.io/projected/393ee73e-a704-4980-8d05-f749c56ef09d-kube-api-access-zd7r7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmxsf\" (UID: \"393ee73e-a704-4980-8d05-f749c56ef09d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:22.274310 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.274288 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1963c8d8-3cc7-4d67-bec5-8438979b8123-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-msd7m\" (UID: \"1963c8d8-3cc7-4d67-bec5-8438979b8123\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.277303 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.277284 2549 projected.go:196] Error preparing data for projected volume kube-api-access-q28gx for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-msd7m" not found Jul 07 00:06:22.277389 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.277364 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1963c8d8-3cc7-4d67-bec5-8438979b8123-kube-api-access-q28gx podName:1963c8d8-3cc7-4d67-bec5-8438979b8123 nodeName:}" failed. No retries permitted until 2026-07-07 00:06:22.777343538 +0000 UTC m=+490.207764297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q28gx" (UniqueName: "kubernetes.io/projected/1963c8d8-3cc7-4d67-bec5-8438979b8123-kube-api-access-q28gx") pod "kuadrant-operator-controller-manager-86878c769f-msd7m" (UID: "1963c8d8-3cc7-4d67-bec5-8438979b8123") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-msd7m" not found Jul 07 00:06:22.303799 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.303777 2549 generic.go:356] "Generic (PLEG): container finished" podID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" containerID="481b466e7eb1506ca79186a419f5ecf8472c8edd7f6a24f2bd8847787e1453a3" exitCode=0 Jul 07 00:06:22.303902 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.303892 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.303976 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.303894 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.306317 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.306292 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9xhl\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:22.308450 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.308425 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-msd7m\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="1963c8d8-3cc7-4d67-bec5-8438979b8123" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.309893 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.309872 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.310321 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.310300 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="29b8fe8f-018a-4853-a401-85af9df3ee27" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.312567 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.312544 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:22.312647 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.312634 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.314747 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.314727 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9xhl\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:22.317052 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.317034 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-msd7m\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="1963c8d8-3cc7-4d67-bec5-8438979b8123" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.318863 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.318845 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="29b8fe8f-018a-4853-a401-85af9df3ee27" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.321873 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.321857 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:22.323832 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.323808 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9xhl\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:22.330278 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.330248 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-msd7m\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="1963c8d8-3cc7-4d67-bec5-8438979b8123" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.337670 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.337582 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="29b8fe8f-018a-4853-a401-85af9df3ee27" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.340082 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.340049 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:22.374482 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374453 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1963c8d8-3cc7-4d67-bec5-8438979b8123-extensions-socket-volume\") pod \"1963c8d8-3cc7-4d67-bec5-8438979b8123\" (UID: \"1963c8d8-3cc7-4d67-bec5-8438979b8123\") " Jul 07 00:06:22.374608 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374541 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29b8fe8f-018a-4853-a401-85af9df3ee27-extensions-socket-volume\") pod \"29b8fe8f-018a-4853-a401-85af9df3ee27\" (UID: \"29b8fe8f-018a-4853-a401-85af9df3ee27\") " Jul 07 00:06:22.374699 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374681 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39dcb566-fb12-4f4c-9e4b-516b9be843f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zzcc9\" (UID: \"39dcb566-fb12-4f4c-9e4b-516b9be843f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" Jul 07 00:06:22.374752 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374728 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hvdz\" (UniqueName: \"kubernetes.io/projected/39dcb566-fb12-4f4c-9e4b-516b9be843f3-kube-api-access-7hvdz\") pod \"kuadrant-operator-controller-manager-86878c769f-zzcc9\" (UID: \"39dcb566-fb12-4f4c-9e4b-516b9be843f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" Jul 07 00:06:22.374802 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374755 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1963c8d8-3cc7-4d67-bec5-8438979b8123-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1963c8d8-3cc7-4d67-bec5-8438979b8123" (UID: "1963c8d8-3cc7-4d67-bec5-8438979b8123"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:06:22.374883 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374843 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/393ee73e-a704-4980-8d05-f749c56ef09d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmxsf\" (UID: \"393ee73e-a704-4980-8d05-f749c56ef09d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:22.374883 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374870 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29b8fe8f-018a-4853-a401-85af9df3ee27-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "29b8fe8f-018a-4853-a401-85af9df3ee27" (UID: "29b8fe8f-018a-4853-a401-85af9df3ee27"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:06:22.375002 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374912 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd7r7\" (UniqueName: \"kubernetes.io/projected/393ee73e-a704-4980-8d05-f749c56ef09d-kube-api-access-zd7r7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmxsf\" (UID: \"393ee73e-a704-4980-8d05-f749c56ef09d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:22.375002 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374969 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q28gx\" (UniqueName: \"kubernetes.io/projected/1963c8d8-3cc7-4d67-bec5-8438979b8123-kube-api-access-q28gx\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:06:22.375002 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374984 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29b8fe8f-018a-4853-a401-85af9df3ee27-extensions-socket-volume\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:06:22.375002 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.374997 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2jt2\" (UniqueName: \"kubernetes.io/projected/29b8fe8f-018a-4853-a401-85af9df3ee27-kube-api-access-c2jt2\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:06:22.375203 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.375010 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1963c8d8-3cc7-4d67-bec5-8438979b8123-extensions-socket-volume\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:06:22.375280 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.375240 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/393ee73e-a704-4980-8d05-f749c56ef09d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmxsf\" (UID: \"393ee73e-a704-4980-8d05-f749c56ef09d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:22.398063 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.397673 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd7r7\" (UniqueName: \"kubernetes.io/projected/393ee73e-a704-4980-8d05-f749c56ef09d-kube-api-access-zd7r7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmxsf\" (UID: \"393ee73e-a704-4980-8d05-f749c56ef09d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:22.461344 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.461325 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:22.463409 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.463393 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:22.464207 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.464186 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="29b8fe8f-018a-4853-a401-85af9df3ee27" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.466534 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.466516 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:22.468888 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.468873 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9xhl\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:22.470898 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.470883 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-msd7m\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="1963c8d8-3cc7-4d67-bec5-8438979b8123" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.476291 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.476272 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hvdz\" (UniqueName: \"kubernetes.io/projected/39dcb566-fb12-4f4c-9e4b-516b9be843f3-kube-api-access-7hvdz\") pod \"kuadrant-operator-controller-manager-86878c769f-zzcc9\" (UID: \"39dcb566-fb12-4f4c-9e4b-516b9be843f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" Jul 07 00:06:22.476379 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.476360 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:22.476448 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.476369 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39dcb566-fb12-4f4c-9e4b-516b9be843f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zzcc9\" (UID: \"39dcb566-fb12-4f4c-9e4b-516b9be843f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" Jul 07 00:06:22.476641 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.476624 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39dcb566-fb12-4f4c-9e4b-516b9be843f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zzcc9\" (UID: \"39dcb566-fb12-4f4c-9e4b-516b9be843f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" Jul 07 00:06:22.479113 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.479093 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9xhl\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:22.481928 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.481911 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-msd7m\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="1963c8d8-3cc7-4d67-bec5-8438979b8123" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:22.484577 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:22.484556 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="29b8fe8f-018a-4853-a401-85af9df3ee27" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:22.497761 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.497739 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hvdz\" (UniqueName: \"kubernetes.io/projected/39dcb566-fb12-4f4c-9e4b-516b9be843f3-kube-api-access-7hvdz\") pod \"kuadrant-operator-controller-manager-86878c769f-zzcc9\" (UID: \"39dcb566-fb12-4f4c-9e4b-516b9be843f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" Jul 07 00:06:22.576861 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.576837 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crg6r\" (UniqueName: \"kubernetes.io/projected/afc6be3f-d6ea-482c-82cc-7d35119f20a3-kube-api-access-crg6r\") pod \"afc6be3f-d6ea-482c-82cc-7d35119f20a3\" (UID: \"afc6be3f-d6ea-482c-82cc-7d35119f20a3\") " Jul 07 00:06:22.576981 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.576879 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfq8w\" (UniqueName: \"kubernetes.io/projected/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-kube-api-access-sfq8w\") pod \"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\" (UID: \"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\") " Jul 07 00:06:22.576981 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.576946 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-extensions-socket-volume\") pod \"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\" (UID: \"94cbc1fc-3273-4d60-8ba1-dd38fdf80f28\") " Jul 07 00:06:22.577374 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.577351 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" (UID: "94cbc1fc-3273-4d60-8ba1-dd38fdf80f28"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:06:22.578902 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.578879 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-kube-api-access-sfq8w" (OuterVolumeSpecName: "kube-api-access-sfq8w") pod "94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" (UID: "94cbc1fc-3273-4d60-8ba1-dd38fdf80f28"). InnerVolumeSpecName "kube-api-access-sfq8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:06:22.578974 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.578885 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc6be3f-d6ea-482c-82cc-7d35119f20a3-kube-api-access-crg6r" (OuterVolumeSpecName: "kube-api-access-crg6r") pod "afc6be3f-d6ea-482c-82cc-7d35119f20a3" (UID: "afc6be3f-d6ea-482c-82cc-7d35119f20a3"). InnerVolumeSpecName "kube-api-access-crg6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:06:22.598049 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.598024 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:22.603992 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.603979 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" Jul 07 00:06:22.678250 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.678209 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-extensions-socket-volume\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:06:22.678250 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.678247 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crg6r\" (UniqueName: \"kubernetes.io/projected/afc6be3f-d6ea-482c-82cc-7d35119f20a3-kube-api-access-crg6r\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:06:22.678498 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.678260 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfq8w\" (UniqueName: \"kubernetes.io/projected/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28-kube-api-access-sfq8w\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:06:22.751455 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.751429 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf"] Jul 07 00:06:22.752838 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:06:22.752815 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393ee73e_a704_4980_8d05_f749c56ef09d.slice/crio-b7747fe881091f7c8c62285c69a8ad338738e9d08e357a241e063a67fabdf11f WatchSource:0}: Error finding container b7747fe881091f7c8c62285c69a8ad338738e9d08e357a241e063a67fabdf11f: Status 404 returned error can't find the container with id b7747fe881091f7c8c62285c69a8ad338738e9d08e357a241e063a67fabdf11f Jul 07 00:06:22.766030 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:22.766010 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9"] Jul 07 00:06:22.768459 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:06:22.768432 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39dcb566_fb12_4f4c_9e4b_516b9be843f3.slice/crio-01e5b394cf0285250b1dcf14c19aa60f9615b71590316a42a6a5492fa9652db2 WatchSource:0}: Error finding container 01e5b394cf0285250b1dcf14c19aa60f9615b71590316a42a6a5492fa9652db2: Status 404 returned error can't find the container with id 01e5b394cf0285250b1dcf14c19aa60f9615b71590316a42a6a5492fa9652db2 Jul 07 00:06:23.089926 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:23.089832 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9xhl\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:23.092160 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:23.092099 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-msd7m\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="1963c8d8-3cc7-4d67-bec5-8438979b8123" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:23.092392 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.092373 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1963c8d8-3cc7-4d67-bec5-8438979b8123" path="/var/lib/kubelet/pods/1963c8d8-3cc7-4d67-bec5-8438979b8123/volumes" Jul 07 00:06:23.092614 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.092601 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29b8fe8f-018a-4853-a401-85af9df3ee27" path="/var/lib/kubelet/pods/29b8fe8f-018a-4853-a401-85af9df3ee27/volumes" Jul 07 00:06:23.092846 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.092833 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" path="/var/lib/kubelet/pods/94cbc1fc-3273-4d60-8ba1-dd38fdf80f28/volumes" Jul 07 00:06:23.093120 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.093106 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" path="/var/lib/kubelet/pods/afc6be3f-d6ea-482c-82cc-7d35119f20a3/volumes" Jul 07 00:06:23.098238 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:23.094469 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="29b8fe8f-018a-4853-a401-85af9df3ee27" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:23.098238 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:23.097213 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjpwp\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="94cbc1fc-3273-4d60-8ba1-dd38fdf80f28" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:23.318569 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.318540 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjpwp" Jul 07 00:06:23.318753 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.318559 2549 scope.go:117] "RemoveContainer" containerID="481b466e7eb1506ca79186a419f5ecf8472c8edd7f6a24f2bd8847787e1453a3" Jul 07 00:06:23.320062 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.319905 2549 generic.go:356] "Generic (PLEG): container finished" podID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" containerID="5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d" exitCode=0 Jul 07 00:06:23.320062 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.320003 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9xhl" Jul 07 00:06:23.321838 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.321812 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" event={"ID":"393ee73e-a704-4980-8d05-f749c56ef09d","Type":"ContainerStarted","Data":"988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1"} Jul 07 00:06:23.321938 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.321898 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" event={"ID":"393ee73e-a704-4980-8d05-f749c56ef09d","Type":"ContainerStarted","Data":"b7747fe881091f7c8c62285c69a8ad338738e9d08e357a241e063a67fabdf11f"} Jul 07 00:06:23.321938 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.321929 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:23.323699 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.323671 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" event={"ID":"39dcb566-fb12-4f4c-9e4b-516b9be843f3","Type":"ContainerStarted","Data":"af29caa5622dc58b76efba846569547c2b9bac06e85d0a76451771c1fb9318fc"} Jul 07 00:06:23.323791 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.323704 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:23.323791 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.323685 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:23.323791 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.323727 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" event={"ID":"39dcb566-fb12-4f4c-9e4b-516b9be843f3","Type":"ContainerStarted","Data":"01e5b394cf0285250b1dcf14c19aa60f9615b71590316a42a6a5492fa9652db2"} Jul 07 00:06:23.323791 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.323756 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" Jul 07 00:06:23.327972 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.327957 2549 scope.go:117] "RemoveContainer" containerID="5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d" Jul 07 00:06:23.335062 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.335041 2549 scope.go:117] "RemoveContainer" containerID="5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d" Jul 07 00:06:23.335400 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:23.335381 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d\": container with ID starting with 5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d not found: ID does not exist" containerID="5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d" Jul 07 00:06:23.335465 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.335409 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d"} err="failed to get container status \"5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d\": rpc error: code = NotFound desc = could not find container \"5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d\": container with ID starting with 5086c7516bce6a979aa373905a27112ef1ba3bb4a574975131c5a582ef78b80d not found: ID does not exist" Jul 07 00:06:23.344914 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.344850 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" podStartSLOduration=1.344838794 podStartE2EDuration="1.344838794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:23.343617045 +0000 UTC m=+490.774037805" watchObservedRunningTime="2026-07-07 00:06:23.344838794 +0000 UTC m=+490.775259555" Jul 07 00:06:23.361284 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:23.361251 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" podStartSLOduration=1.3612137770000001 podStartE2EDuration="1.361213777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:23.360881853 +0000 UTC m=+490.791302604" watchObservedRunningTime="2026-07-07 00:06:23.361213777 +0000 UTC m=+490.791634536" Jul 07 00:06:23.362997 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:23.362960 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vj7fx\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="29b8fe8f-018a-4853-a401-85af9df3ee27" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vj7fx" Jul 07 00:06:23.364945 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:23.364915 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-msd7m\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="1963c8d8-3cc7-4d67-bec5-8438979b8123" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-msd7m" Jul 07 00:06:34.331774 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.331744 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:34.332365 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.331824 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zzcc9" Jul 07 00:06:34.407321 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.407292 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf"] Jul 07 00:06:34.407480 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.407455 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" podUID="393ee73e-a704-4980-8d05-f749c56ef09d" containerName="manager" containerID="cri-o://988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1" gracePeriod=10 Jul 07 00:06:34.659855 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.659829 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:34.783778 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.783742 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd7r7\" (UniqueName: \"kubernetes.io/projected/393ee73e-a704-4980-8d05-f749c56ef09d-kube-api-access-zd7r7\") pod \"393ee73e-a704-4980-8d05-f749c56ef09d\" (UID: \"393ee73e-a704-4980-8d05-f749c56ef09d\") " Jul 07 00:06:34.783956 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.783820 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/393ee73e-a704-4980-8d05-f749c56ef09d-extensions-socket-volume\") pod \"393ee73e-a704-4980-8d05-f749c56ef09d\" (UID: \"393ee73e-a704-4980-8d05-f749c56ef09d\") " Jul 07 00:06:34.784203 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.784178 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393ee73e-a704-4980-8d05-f749c56ef09d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "393ee73e-a704-4980-8d05-f749c56ef09d" (UID: "393ee73e-a704-4980-8d05-f749c56ef09d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:06:34.785735 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.785716 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393ee73e-a704-4980-8d05-f749c56ef09d-kube-api-access-zd7r7" (OuterVolumeSpecName: "kube-api-access-zd7r7") pod "393ee73e-a704-4980-8d05-f749c56ef09d" (UID: "393ee73e-a704-4980-8d05-f749c56ef09d"). InnerVolumeSpecName "kube-api-access-zd7r7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:06:34.885315 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.885215 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/393ee73e-a704-4980-8d05-f749c56ef09d-extensions-socket-volume\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:06:34.885315 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:34.885261 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd7r7\" (UniqueName: \"kubernetes.io/projected/393ee73e-a704-4980-8d05-f749c56ef09d-kube-api-access-zd7r7\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:06:35.378277 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:35.378242 2549 generic.go:356] "Generic (PLEG): container finished" podID="393ee73e-a704-4980-8d05-f749c56ef09d" containerID="988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1" exitCode=0 Jul 07 00:06:35.378713 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:35.378287 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" event={"ID":"393ee73e-a704-4980-8d05-f749c56ef09d","Type":"ContainerDied","Data":"988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1"} Jul 07 00:06:35.378713 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:35.378299 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" Jul 07 00:06:35.378713 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:35.378370 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf" event={"ID":"393ee73e-a704-4980-8d05-f749c56ef09d","Type":"ContainerDied","Data":"b7747fe881091f7c8c62285c69a8ad338738e9d08e357a241e063a67fabdf11f"} Jul 07 00:06:35.378713 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:35.378403 2549 scope.go:117] "RemoveContainer" containerID="988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1" Jul 07 00:06:35.386880 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:35.386861 2549 scope.go:117] "RemoveContainer" containerID="988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1" Jul 07 00:06:35.387117 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:06:35.387099 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1\": container with ID starting with 988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1 not found: ID does not exist" containerID="988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1" Jul 07 00:06:35.387171 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:35.387125 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1"} err="failed to get container status \"988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1\": rpc error: code = NotFound desc = could not find container \"988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1\": container with ID starting with 988cc404094fba35ffb39e5e19e90ff04491aa9693338a97b225c2cb42d1b4f1 not found: ID does not exist" Jul 07 00:06:35.410543 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:35.410518 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf"] Jul 07 00:06:35.417320 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:35.417300 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmxsf"] Jul 07 00:06:37.091496 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:37.091466 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="393ee73e-a704-4980-8d05-f749c56ef09d" path="/var/lib/kubelet/pods/393ee73e-a704-4980-8d05-f749c56ef09d/volumes" Jul 07 00:06:54.216128 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.216089 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-bzhbx"] Jul 07 00:06:54.216611 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.216589 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393ee73e-a704-4980-8d05-f749c56ef09d" containerName="manager" Jul 07 00:06:54.216677 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.216615 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="393ee73e-a704-4980-8d05-f749c56ef09d" containerName="manager" Jul 07 00:06:54.216677 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.216650 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" containerName="manager" Jul 07 00:06:54.216677 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.216658 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" containerName="manager" Jul 07 00:06:54.216805 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.216746 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="afc6be3f-d6ea-482c-82cc-7d35119f20a3" containerName="manager" Jul 07 00:06:54.216805 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.216760 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="393ee73e-a704-4980-8d05-f749c56ef09d" containerName="manager" Jul 07 00:06:54.221584 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.221563 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bzhbx" Jul 07 00:06:54.225237 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.225203 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wc8cr\"" Jul 07 00:06:54.231036 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.231016 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bzhbx"] Jul 07 00:06:54.254407 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.254385 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6mwv\" (UniqueName: \"kubernetes.io/projected/40ecdead-7d62-48a1-9606-894c01e9973c-kube-api-access-c6mwv\") pod \"authorino-58cd955675-bzhbx\" (UID: \"40ecdead-7d62-48a1-9606-894c01e9973c\") " pod="kuadrant-system/authorino-58cd955675-bzhbx" Jul 07 00:06:54.355708 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.355671 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6mwv\" (UniqueName: \"kubernetes.io/projected/40ecdead-7d62-48a1-9606-894c01e9973c-kube-api-access-c6mwv\") pod \"authorino-58cd955675-bzhbx\" (UID: \"40ecdead-7d62-48a1-9606-894c01e9973c\") " pod="kuadrant-system/authorino-58cd955675-bzhbx" Jul 07 00:06:54.370701 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.370664 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6mwv\" (UniqueName: \"kubernetes.io/projected/40ecdead-7d62-48a1-9606-894c01e9973c-kube-api-access-c6mwv\") pod \"authorino-58cd955675-bzhbx\" (UID: \"40ecdead-7d62-48a1-9606-894c01e9973c\") " pod="kuadrant-system/authorino-58cd955675-bzhbx" Jul 07 00:06:54.419216 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.419182 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-5xnbw"] Jul 07 00:06:54.421341 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.421326 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5xnbw" Jul 07 00:06:54.432357 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.432331 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5xnbw"] Jul 07 00:06:54.456370 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.456341 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqs77\" (UniqueName: \"kubernetes.io/projected/a230bbfd-ab47-48f4-9eb8-a69783834c2e-kube-api-access-wqs77\") pod \"authorino-75d556bd77-5xnbw\" (UID: \"a230bbfd-ab47-48f4-9eb8-a69783834c2e\") " pod="kuadrant-system/authorino-75d556bd77-5xnbw" Jul 07 00:06:54.531107 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.531033 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bzhbx" Jul 07 00:06:54.556981 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.556953 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqs77\" (UniqueName: \"kubernetes.io/projected/a230bbfd-ab47-48f4-9eb8-a69783834c2e-kube-api-access-wqs77\") pod \"authorino-75d556bd77-5xnbw\" (UID: \"a230bbfd-ab47-48f4-9eb8-a69783834c2e\") " pod="kuadrant-system/authorino-75d556bd77-5xnbw" Jul 07 00:06:54.568018 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.567985 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqs77\" (UniqueName: \"kubernetes.io/projected/a230bbfd-ab47-48f4-9eb8-a69783834c2e-kube-api-access-wqs77\") pod \"authorino-75d556bd77-5xnbw\" (UID: \"a230bbfd-ab47-48f4-9eb8-a69783834c2e\") " pod="kuadrant-system/authorino-75d556bd77-5xnbw" Jul 07 00:06:54.622093 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.622051 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ct77d"] Jul 07 00:06:54.625400 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.625378 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:06:54.628829 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.628628 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zpvrx\"" Jul 07 00:06:54.628829 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.628703 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 00:06:54.639076 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.639052 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ct77d"] Jul 07 00:06:54.657665 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.657634 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vm8m\" (UniqueName: \"kubernetes.io/projected/19d6e0de-33da-493e-9a2e-66981ef46682-kube-api-access-6vm8m\") pod \"limitador-limitador-64c94fd64f-ct77d\" (UID: \"19d6e0de-33da-493e-9a2e-66981ef46682\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:06:54.657789 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.657695 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/19d6e0de-33da-493e-9a2e-66981ef46682-config-file\") pod \"limitador-limitador-64c94fd64f-ct77d\" (UID: \"19d6e0de-33da-493e-9a2e-66981ef46682\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:06:54.665699 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.665676 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bzhbx"] Jul 07 00:06:54.666963 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:06:54.666941 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40ecdead_7d62_48a1_9606_894c01e9973c.slice/crio-effcd33d13cfa8fbee265b72e096058bc25844457dd5f683a63fdc0917c580dc WatchSource:0}: Error finding container effcd33d13cfa8fbee265b72e096058bc25844457dd5f683a63fdc0917c580dc: Status 404 returned error can't find the container with id effcd33d13cfa8fbee265b72e096058bc25844457dd5f683a63fdc0917c580dc Jul 07 00:06:54.724215 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.724186 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ct77d"] Jul 07 00:06:54.730723 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.730699 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5xnbw" Jul 07 00:06:54.758952 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.758923 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vm8m\" (UniqueName: \"kubernetes.io/projected/19d6e0de-33da-493e-9a2e-66981ef46682-kube-api-access-6vm8m\") pod \"limitador-limitador-64c94fd64f-ct77d\" (UID: \"19d6e0de-33da-493e-9a2e-66981ef46682\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:06:54.759118 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.759012 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/19d6e0de-33da-493e-9a2e-66981ef46682-config-file\") pod \"limitador-limitador-64c94fd64f-ct77d\" (UID: \"19d6e0de-33da-493e-9a2e-66981ef46682\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:06:54.759666 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.759647 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/19d6e0de-33da-493e-9a2e-66981ef46682-config-file\") pod \"limitador-limitador-64c94fd64f-ct77d\" (UID: \"19d6e0de-33da-493e-9a2e-66981ef46682\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:06:54.768832 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.768758 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vm8m\" (UniqueName: \"kubernetes.io/projected/19d6e0de-33da-493e-9a2e-66981ef46682-kube-api-access-6vm8m\") pod \"limitador-limitador-64c94fd64f-ct77d\" (UID: \"19d6e0de-33da-493e-9a2e-66981ef46682\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:06:54.859926 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.859894 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5xnbw"] Jul 07 00:06:54.863374 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:06:54.863348 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda230bbfd_ab47_48f4_9eb8_a69783834c2e.slice/crio-560529cbf9f3f8ee79497d5c088c7f9476f740c2de30c75e8e90e3609685f947 WatchSource:0}: Error finding container 560529cbf9f3f8ee79497d5c088c7f9476f740c2de30c75e8e90e3609685f947: Status 404 returned error can't find the container with id 560529cbf9f3f8ee79497d5c088c7f9476f740c2de30c75e8e90e3609685f947 Jul 07 00:06:54.938929 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:54.938894 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:06:55.075092 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:55.075070 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ct77d"] Jul 07 00:06:55.076930 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:06:55.076904 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d6e0de_33da_493e_9a2e_66981ef46682.slice/crio-83e66d9253c96bcdbf8377dbeebf8b30ab6e5131af8091beaa8aca642e467ac7 WatchSource:0}: Error finding container 83e66d9253c96bcdbf8377dbeebf8b30ab6e5131af8091beaa8aca642e467ac7: Status 404 returned error can't find the container with id 83e66d9253c96bcdbf8377dbeebf8b30ab6e5131af8091beaa8aca642e467ac7 Jul 07 00:06:55.496983 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:55.496924 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5xnbw" event={"ID":"a230bbfd-ab47-48f4-9eb8-a69783834c2e","Type":"ContainerStarted","Data":"560529cbf9f3f8ee79497d5c088c7f9476f740c2de30c75e8e90e3609685f947"} Jul 07 00:06:55.502715 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:55.502615 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bzhbx" event={"ID":"40ecdead-7d62-48a1-9606-894c01e9973c","Type":"ContainerStarted","Data":"effcd33d13cfa8fbee265b72e096058bc25844457dd5f683a63fdc0917c580dc"} Jul 07 00:06:55.504986 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:06:55.504917 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" event={"ID":"19d6e0de-33da-493e-9a2e-66981ef46682","Type":"ContainerStarted","Data":"83e66d9253c96bcdbf8377dbeebf8b30ab6e5131af8091beaa8aca642e467ac7"} Jul 07 00:07:00.535318 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:00.535284 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5xnbw" event={"ID":"a230bbfd-ab47-48f4-9eb8-a69783834c2e","Type":"ContainerStarted","Data":"9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a"} Jul 07 00:07:00.536773 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:00.536752 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bzhbx" event={"ID":"40ecdead-7d62-48a1-9606-894c01e9973c","Type":"ContainerStarted","Data":"44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079"} Jul 07 00:07:00.538057 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:00.538039 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" event={"ID":"19d6e0de-33da-493e-9a2e-66981ef46682","Type":"ContainerStarted","Data":"0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520"} Jul 07 00:07:00.538195 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:00.538171 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:07:00.552160 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:00.552120 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-5xnbw" podStartSLOduration=1.5122402990000001 podStartE2EDuration="6.552107174s" totalImagesPullingTime="5.039866875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:00.550380217 +0000 UTC m=+527.980800981" watchObservedRunningTime="2026-07-07 00:07:00.552107174 +0000 UTC m=+527.982527935" Jul 07 00:07:00.567855 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:00.567812 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" podStartSLOduration=1.687056999 podStartE2EDuration="6.567797835s" totalImagesPullingTime="4.880740836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:00.56737164 +0000 UTC m=+527.997792402" watchObservedRunningTime="2026-07-07 00:07:00.567797835 +0000 UTC m=+527.998218595" Jul 07 00:07:00.583822 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:00.583796 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bzhbx"] Jul 07 00:07:00.596042 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:00.596001 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-bzhbx" podStartSLOduration=1.35949841 podStartE2EDuration="6.595983639s" totalImagesPullingTime="5.236485229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:00.594458271 +0000 UTC m=+528.024879032" watchObservedRunningTime="2026-07-07 00:07:00.595983639 +0000 UTC m=+528.026404400" Jul 07 00:07:02.546563 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:02.546522 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-bzhbx" podUID="40ecdead-7d62-48a1-9606-894c01e9973c" containerName="authorino" containerID="cri-o://44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079" gracePeriod=30 Jul 07 00:07:02.805982 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:02.805926 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bzhbx" Jul 07 00:07:02.934957 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:02.934928 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6mwv\" (UniqueName: \"kubernetes.io/projected/40ecdead-7d62-48a1-9606-894c01e9973c-kube-api-access-c6mwv\") pod \"40ecdead-7d62-48a1-9606-894c01e9973c\" (UID: \"40ecdead-7d62-48a1-9606-894c01e9973c\") " Jul 07 00:07:02.936989 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:02.936958 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ecdead-7d62-48a1-9606-894c01e9973c-kube-api-access-c6mwv" (OuterVolumeSpecName: "kube-api-access-c6mwv") pod "40ecdead-7d62-48a1-9606-894c01e9973c" (UID: "40ecdead-7d62-48a1-9606-894c01e9973c"). InnerVolumeSpecName "kube-api-access-c6mwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:03.036445 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:03.036405 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6mwv\" (UniqueName: \"kubernetes.io/projected/40ecdead-7d62-48a1-9606-894c01e9973c-kube-api-access-c6mwv\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:07:03.552091 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:03.552058 2549 generic.go:356] "Generic (PLEG): container finished" podID="40ecdead-7d62-48a1-9606-894c01e9973c" containerID="44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079" exitCode=0 Jul 07 00:07:03.552602 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:03.552102 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bzhbx" event={"ID":"40ecdead-7d62-48a1-9606-894c01e9973c","Type":"ContainerDied","Data":"44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079"} Jul 07 00:07:03.552602 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:03.552108 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bzhbx" Jul 07 00:07:03.552602 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:03.552130 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bzhbx" event={"ID":"40ecdead-7d62-48a1-9606-894c01e9973c","Type":"ContainerDied","Data":"effcd33d13cfa8fbee265b72e096058bc25844457dd5f683a63fdc0917c580dc"} Jul 07 00:07:03.552602 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:03.552146 2549 scope.go:117] "RemoveContainer" containerID="44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079" Jul 07 00:07:03.560814 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:03.560796 2549 scope.go:117] "RemoveContainer" containerID="44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079" Jul 07 00:07:03.561073 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:07:03.561057 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079\": container with ID starting with 44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079 not found: ID does not exist" containerID="44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079" Jul 07 00:07:03.561118 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:03.561081 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079"} err="failed to get container status \"44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079\": rpc error: code = NotFound desc = could not find container \"44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079\": container with ID starting with 44f374c0cca972a1c2f9b93355f9ea6802f1b48c88a621b2db88452bea299079 not found: ID does not exist" Jul 07 00:07:03.568331 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:03.568306 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bzhbx"] Jul 07 00:07:03.572290 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:03.572270 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-bzhbx"] Jul 07 00:07:05.091765 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:05.091695 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ecdead-7d62-48a1-9606-894c01e9973c" path="/var/lib/kubelet/pods/40ecdead-7d62-48a1-9606-894c01e9973c/volumes" Jul 07 00:07:09.276104 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:09.276066 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ct77d"] Jul 07 00:07:09.276708 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:09.276257 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" podUID="19d6e0de-33da-493e-9a2e-66981ef46682" containerName="limitador" containerID="cri-o://0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520" gracePeriod=30 Jul 07 00:07:09.278665 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:09.278637 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:07:09.850773 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:09.850749 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:07:09.893831 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:09.893794 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/19d6e0de-33da-493e-9a2e-66981ef46682-config-file\") pod \"19d6e0de-33da-493e-9a2e-66981ef46682\" (UID: \"19d6e0de-33da-493e-9a2e-66981ef46682\") " Jul 07 00:07:09.893831 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:09.893833 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vm8m\" (UniqueName: \"kubernetes.io/projected/19d6e0de-33da-493e-9a2e-66981ef46682-kube-api-access-6vm8m\") pod \"19d6e0de-33da-493e-9a2e-66981ef46682\" (UID: \"19d6e0de-33da-493e-9a2e-66981ef46682\") " Jul 07 00:07:09.894218 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:09.894192 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19d6e0de-33da-493e-9a2e-66981ef46682-config-file" (OuterVolumeSpecName: "config-file") pod "19d6e0de-33da-493e-9a2e-66981ef46682" (UID: "19d6e0de-33da-493e-9a2e-66981ef46682"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:07:09.895880 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:09.895853 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19d6e0de-33da-493e-9a2e-66981ef46682-kube-api-access-6vm8m" (OuterVolumeSpecName: "kube-api-access-6vm8m") pod "19d6e0de-33da-493e-9a2e-66981ef46682" (UID: "19d6e0de-33da-493e-9a2e-66981ef46682"). InnerVolumeSpecName "kube-api-access-6vm8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:09.995380 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:09.995349 2549 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/19d6e0de-33da-493e-9a2e-66981ef46682-config-file\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:07:09.995380 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:09.995377 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vm8m\" (UniqueName: \"kubernetes.io/projected/19d6e0de-33da-493e-9a2e-66981ef46682-kube-api-access-6vm8m\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:07:10.585962 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:10.585931 2549 generic.go:356] "Generic (PLEG): container finished" podID="19d6e0de-33da-493e-9a2e-66981ef46682" containerID="0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520" exitCode=0 Jul 07 00:07:10.586413 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:10.585973 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" Jul 07 00:07:10.586413 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:10.586022 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" event={"ID":"19d6e0de-33da-493e-9a2e-66981ef46682","Type":"ContainerDied","Data":"0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520"} Jul 07 00:07:10.586413 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:10.586068 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ct77d" event={"ID":"19d6e0de-33da-493e-9a2e-66981ef46682","Type":"ContainerDied","Data":"83e66d9253c96bcdbf8377dbeebf8b30ab6e5131af8091beaa8aca642e467ac7"} Jul 07 00:07:10.586413 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:10.586090 2549 scope.go:117] "RemoveContainer" containerID="0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520" Jul 07 00:07:10.595298 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:10.595276 2549 scope.go:117] "RemoveContainer" containerID="0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520" Jul 07 00:07:10.595579 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:07:10.595560 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520\": container with ID starting with 0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520 not found: ID does not exist" containerID="0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520" Jul 07 00:07:10.595626 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:10.595586 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520"} err="failed to get container status \"0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520\": rpc error: code = NotFound desc = could not find container \"0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520\": container with ID starting with 0ef21458a0100c0b4c675c321f8b13327bf74ea56951984d4f680fb01927a520 not found: ID does not exist" Jul 07 00:07:10.608654 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:10.608621 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ct77d"] Jul 07 00:07:10.612787 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:10.612760 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ct77d"] Jul 07 00:07:11.091485 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:11.091452 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19d6e0de-33da-493e-9a2e-66981ef46682" path="/var/lib/kubelet/pods/19d6e0de-33da-493e-9a2e-66981ef46682/volumes" Jul 07 00:07:14.847427 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.847394 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-wnn7d"] Jul 07 00:07:14.847782 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.847751 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ecdead-7d62-48a1-9606-894c01e9973c" containerName="authorino" Jul 07 00:07:14.847782 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.847762 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ecdead-7d62-48a1-9606-894c01e9973c" containerName="authorino" Jul 07 00:07:14.847782 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.847772 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19d6e0de-33da-493e-9a2e-66981ef46682" containerName="limitador" Jul 07 00:07:14.847782 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.847777 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="19d6e0de-33da-493e-9a2e-66981ef46682" containerName="limitador" Jul 07 00:07:14.847926 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.847862 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ecdead-7d62-48a1-9606-894c01e9973c" containerName="authorino" Jul 07 00:07:14.847926 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.847876 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="19d6e0de-33da-493e-9a2e-66981ef46682" containerName="limitador" Jul 07 00:07:14.852668 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.852646 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wnn7d" Jul 07 00:07:14.855041 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.855022 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 00:07:14.855188 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.855169 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zfkms\"" Jul 07 00:07:14.859664 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.859639 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wnn7d"] Jul 07 00:07:14.936741 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.936702 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9fb879b0-aaef-41b5-94dd-831f07af0c36-data\") pod \"postgres-69fb4594cf-wnn7d\" (UID: \"9fb879b0-aaef-41b5-94dd-831f07af0c36\") " pod="opendatahub/postgres-69fb4594cf-wnn7d" Jul 07 00:07:14.936918 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:14.936763 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjf44\" (UniqueName: \"kubernetes.io/projected/9fb879b0-aaef-41b5-94dd-831f07af0c36-kube-api-access-rjf44\") pod \"postgres-69fb4594cf-wnn7d\" (UID: \"9fb879b0-aaef-41b5-94dd-831f07af0c36\") " pod="opendatahub/postgres-69fb4594cf-wnn7d" Jul 07 00:07:15.038174 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:15.038133 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9fb879b0-aaef-41b5-94dd-831f07af0c36-data\") pod \"postgres-69fb4594cf-wnn7d\" (UID: \"9fb879b0-aaef-41b5-94dd-831f07af0c36\") " pod="opendatahub/postgres-69fb4594cf-wnn7d" Jul 07 00:07:15.038374 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:15.038194 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjf44\" (UniqueName: \"kubernetes.io/projected/9fb879b0-aaef-41b5-94dd-831f07af0c36-kube-api-access-rjf44\") pod \"postgres-69fb4594cf-wnn7d\" (UID: \"9fb879b0-aaef-41b5-94dd-831f07af0c36\") " pod="opendatahub/postgres-69fb4594cf-wnn7d" Jul 07 00:07:15.038551 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:15.038532 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9fb879b0-aaef-41b5-94dd-831f07af0c36-data\") pod \"postgres-69fb4594cf-wnn7d\" (UID: \"9fb879b0-aaef-41b5-94dd-831f07af0c36\") " pod="opendatahub/postgres-69fb4594cf-wnn7d" Jul 07 00:07:15.058979 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:15.058949 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjf44\" (UniqueName: \"kubernetes.io/projected/9fb879b0-aaef-41b5-94dd-831f07af0c36-kube-api-access-rjf44\") pod \"postgres-69fb4594cf-wnn7d\" (UID: \"9fb879b0-aaef-41b5-94dd-831f07af0c36\") " pod="opendatahub/postgres-69fb4594cf-wnn7d" Jul 07 00:07:15.163916 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:15.163835 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wnn7d" Jul 07 00:07:15.302132 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:15.302106 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wnn7d"] Jul 07 00:07:15.304757 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:07:15.304714 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb879b0_aaef_41b5_94dd_831f07af0c36.slice/crio-b5aaeab18e3b9dc5d4dfb3662707cbeab8d6bc68f8a817ca91dfbd45913fc99c WatchSource:0}: Error finding container b5aaeab18e3b9dc5d4dfb3662707cbeab8d6bc68f8a817ca91dfbd45913fc99c: Status 404 returned error can't find the container with id b5aaeab18e3b9dc5d4dfb3662707cbeab8d6bc68f8a817ca91dfbd45913fc99c Jul 07 00:07:15.610806 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:15.610768 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wnn7d" event={"ID":"9fb879b0-aaef-41b5-94dd-831f07af0c36","Type":"ContainerStarted","Data":"b5aaeab18e3b9dc5d4dfb3662707cbeab8d6bc68f8a817ca91dfbd45913fc99c"} Jul 07 00:07:20.638219 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:20.638184 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wnn7d" event={"ID":"9fb879b0-aaef-41b5-94dd-831f07af0c36","Type":"ContainerStarted","Data":"3e39de66c2f03885aef1ddab99396a20f8e98dfae7662a13a36a1bd103f06847"} Jul 07 00:07:20.638656 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:20.638323 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-wnn7d" Jul 07 00:07:20.655714 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:20.655669 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-wnn7d" podStartSLOduration=1.811141415 podStartE2EDuration="6.655643097s" totalImagesPullingTime="4.844501682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:20.654333996 +0000 UTC m=+548.084754769" watchObservedRunningTime="2026-07-07 00:07:20.655643097 +0000 UTC m=+548.086063859" Jul 07 00:07:26.673649 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:26.673619 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-wnn7d" Jul 07 00:07:27.237769 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.237734 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-498gd"] Jul 07 00:07:27.244799 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.244771 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-498gd" Jul 07 00:07:27.250385 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.250356 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-498gd"] Jul 07 00:07:27.349818 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.349776 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b54r8\" (UniqueName: \"kubernetes.io/projected/45f963ee-4e46-4ee0-aabc-787ad300f43c-kube-api-access-b54r8\") pod \"authorino-5d4b67c446-498gd\" (UID: \"45f963ee-4e46-4ee0-aabc-787ad300f43c\") " pod="kuadrant-system/authorino-5d4b67c446-498gd" Jul 07 00:07:27.421290 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.421257 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-498gd"] Jul 07 00:07:27.421570 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:07:27.421546 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-b54r8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-498gd" podUID="45f963ee-4e46-4ee0-aabc-787ad300f43c" Jul 07 00:07:27.449286 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.449246 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-qsqp8"] Jul 07 00:07:27.450883 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.450855 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b54r8\" (UniqueName: \"kubernetes.io/projected/45f963ee-4e46-4ee0-aabc-787ad300f43c-kube-api-access-b54r8\") pod \"authorino-5d4b67c446-498gd\" (UID: \"45f963ee-4e46-4ee0-aabc-787ad300f43c\") " pod="kuadrant-system/authorino-5d4b67c446-498gd" Jul 07 00:07:27.453052 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.453036 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qsqp8" Jul 07 00:07:27.455334 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.455316 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 00:07:27.459786 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.459760 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-qsqp8"] Jul 07 00:07:27.462176 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.462150 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b54r8\" (UniqueName: \"kubernetes.io/projected/45f963ee-4e46-4ee0-aabc-787ad300f43c-kube-api-access-b54r8\") pod \"authorino-5d4b67c446-498gd\" (UID: \"45f963ee-4e46-4ee0-aabc-787ad300f43c\") " pod="kuadrant-system/authorino-5d4b67c446-498gd" Jul 07 00:07:27.496214 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.496132 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-qsqp8"] Jul 07 00:07:27.496423 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:07:27.496402 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d4sr8 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-qsqp8" podUID="9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4" Jul 07 00:07:27.525786 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.525749 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d7d697f67-4qqfh"] Jul 07 00:07:27.532278 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.530792 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d7d697f67-4qqfh" Jul 07 00:07:27.538112 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.538083 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d7d697f67-4qqfh"] Jul 07 00:07:27.551537 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.551500 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-tls-cert\") pod \"authorino-76877994-qsqp8\" (UID: \"9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4\") " pod="kuadrant-system/authorino-76877994-qsqp8" Jul 07 00:07:27.551537 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.551540 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4sr8\" (UniqueName: \"kubernetes.io/projected/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-kube-api-access-d4sr8\") pod \"authorino-76877994-qsqp8\" (UID: \"9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4\") " pod="kuadrant-system/authorino-76877994-qsqp8" Jul 07 00:07:27.652808 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.652773 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-tls-cert\") pod \"authorino-76877994-qsqp8\" (UID: \"9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4\") " pod="kuadrant-system/authorino-76877994-qsqp8" Jul 07 00:07:27.652808 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.652812 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4sr8\" (UniqueName: \"kubernetes.io/projected/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-kube-api-access-d4sr8\") pod \"authorino-76877994-qsqp8\" (UID: \"9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4\") " pod="kuadrant-system/authorino-76877994-qsqp8" Jul 07 00:07:27.653063 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.653004 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njm88\" (UniqueName: \"kubernetes.io/projected/84dd62bb-f199-475b-bb1b-94e2a6377c0b-kube-api-access-njm88\") pod \"authorino-d7d697f67-4qqfh\" (UID: \"84dd62bb-f199-475b-bb1b-94e2a6377c0b\") " pod="kuadrant-system/authorino-d7d697f67-4qqfh" Jul 07 00:07:27.653063 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.653046 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84dd62bb-f199-475b-bb1b-94e2a6377c0b-tls-cert\") pod \"authorino-d7d697f67-4qqfh\" (UID: \"84dd62bb-f199-475b-bb1b-94e2a6377c0b\") " pod="kuadrant-system/authorino-d7d697f67-4qqfh" Jul 07 00:07:27.655319 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.655293 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-tls-cert\") pod \"authorino-76877994-qsqp8\" (UID: \"9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4\") " pod="kuadrant-system/authorino-76877994-qsqp8" Jul 07 00:07:27.662293 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.662265 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4sr8\" (UniqueName: \"kubernetes.io/projected/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-kube-api-access-d4sr8\") pod \"authorino-76877994-qsqp8\" (UID: \"9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4\") " pod="kuadrant-system/authorino-76877994-qsqp8" Jul 07 00:07:27.669761 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.669732 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qsqp8" Jul 07 00:07:27.669890 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.669732 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-498gd" Jul 07 00:07:27.677667 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.677644 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qsqp8" Jul 07 00:07:27.680413 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.680397 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-498gd" Jul 07 00:07:27.754393 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.754309 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njm88\" (UniqueName: \"kubernetes.io/projected/84dd62bb-f199-475b-bb1b-94e2a6377c0b-kube-api-access-njm88\") pod \"authorino-d7d697f67-4qqfh\" (UID: \"84dd62bb-f199-475b-bb1b-94e2a6377c0b\") " pod="kuadrant-system/authorino-d7d697f67-4qqfh" Jul 07 00:07:27.754393 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.754344 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84dd62bb-f199-475b-bb1b-94e2a6377c0b-tls-cert\") pod \"authorino-d7d697f67-4qqfh\" (UID: \"84dd62bb-f199-475b-bb1b-94e2a6377c0b\") " pod="kuadrant-system/authorino-d7d697f67-4qqfh" Jul 07 00:07:27.756914 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.756880 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84dd62bb-f199-475b-bb1b-94e2a6377c0b-tls-cert\") pod \"authorino-d7d697f67-4qqfh\" (UID: \"84dd62bb-f199-475b-bb1b-94e2a6377c0b\") " pod="kuadrant-system/authorino-d7d697f67-4qqfh" Jul 07 00:07:27.763015 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.762995 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njm88\" (UniqueName: \"kubernetes.io/projected/84dd62bb-f199-475b-bb1b-94e2a6377c0b-kube-api-access-njm88\") pod \"authorino-d7d697f67-4qqfh\" (UID: \"84dd62bb-f199-475b-bb1b-94e2a6377c0b\") " pod="kuadrant-system/authorino-d7d697f67-4qqfh" Jul 07 00:07:27.843191 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.843146 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d7d697f67-4qqfh" Jul 07 00:07:27.854796 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.854772 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4sr8\" (UniqueName: \"kubernetes.io/projected/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-kube-api-access-d4sr8\") pod \"9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4\" (UID: \"9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4\") " Jul 07 00:07:27.854870 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.854849 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-tls-cert\") pod \"9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4\" (UID: \"9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4\") " Jul 07 00:07:27.854912 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.854873 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b54r8\" (UniqueName: \"kubernetes.io/projected/45f963ee-4e46-4ee0-aabc-787ad300f43c-kube-api-access-b54r8\") pod \"45f963ee-4e46-4ee0-aabc-787ad300f43c\" (UID: \"45f963ee-4e46-4ee0-aabc-787ad300f43c\") " Jul 07 00:07:27.856943 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.856908 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4" (UID: "9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:07:27.857041 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.856920 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45f963ee-4e46-4ee0-aabc-787ad300f43c-kube-api-access-b54r8" (OuterVolumeSpecName: "kube-api-access-b54r8") pod "45f963ee-4e46-4ee0-aabc-787ad300f43c" (UID: "45f963ee-4e46-4ee0-aabc-787ad300f43c"). InnerVolumeSpecName "kube-api-access-b54r8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:27.857041 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.856951 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-kube-api-access-d4sr8" (OuterVolumeSpecName: "kube-api-access-d4sr8") pod "9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4" (UID: "9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4"). InnerVolumeSpecName "kube-api-access-d4sr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:27.966214 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.966165 2549 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-tls-cert\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:07:27.966214 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.966217 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b54r8\" (UniqueName: \"kubernetes.io/projected/45f963ee-4e46-4ee0-aabc-787ad300f43c-kube-api-access-b54r8\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:07:27.966446 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:27.966251 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4sr8\" (UniqueName: \"kubernetes.io/projected/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4-kube-api-access-d4sr8\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:07:28.001933 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.001908 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d7d697f67-4qqfh"] Jul 07 00:07:28.004904 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:07:28.004842 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84dd62bb_f199_475b_bb1b_94e2a6377c0b.slice/crio-abd2608777b673abeeaf39402b84a6ce8b1161db7fa45e6f925460ae1099a092 WatchSource:0}: Error finding container abd2608777b673abeeaf39402b84a6ce8b1161db7fa45e6f925460ae1099a092: Status 404 returned error can't find the container with id abd2608777b673abeeaf39402b84a6ce8b1161db7fa45e6f925460ae1099a092 Jul 07 00:07:28.675810 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.675761 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d7d697f67-4qqfh" event={"ID":"84dd62bb-f199-475b-bb1b-94e2a6377c0b","Type":"ContainerStarted","Data":"d32ed3c06cdfef08c5bb3dd4a82f3b81ee9b0800d539bfd70f2b3eb7496f61ad"} Jul 07 00:07:28.676005 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.675819 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d7d697f67-4qqfh" event={"ID":"84dd62bb-f199-475b-bb1b-94e2a6377c0b","Type":"ContainerStarted","Data":"abd2608777b673abeeaf39402b84a6ce8b1161db7fa45e6f925460ae1099a092"} Jul 07 00:07:28.676005 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.675882 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-498gd" Jul 07 00:07:28.676005 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.675977 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-qsqp8" Jul 07 00:07:28.707614 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.707551 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d7d697f67-4qqfh" podStartSLOduration=1.2820354250000001 podStartE2EDuration="1.707528429s" totalImagesPullingTime="425.493004ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:28.692799729 +0000 UTC m=+556.123220490" watchObservedRunningTime="2026-07-07 00:07:28.707528429 +0000 UTC m=+556.137949387" Jul 07 00:07:28.716682 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.716653 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-498gd"] Jul 07 00:07:28.722573 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.722547 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5xnbw"] Jul 07 00:07:28.722745 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.722724 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-5xnbw" podUID="a230bbfd-ab47-48f4-9eb8-a69783834c2e" containerName="authorino" containerID="cri-o://9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a" gracePeriod=30 Jul 07 00:07:28.731461 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.731427 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-498gd"] Jul 07 00:07:28.753834 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.753794 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-qsqp8"] Jul 07 00:07:28.757820 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.757792 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-qsqp8"] Jul 07 00:07:28.983704 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:28.983671 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5xnbw" Jul 07 00:07:29.092061 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.092026 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45f963ee-4e46-4ee0-aabc-787ad300f43c" path="/var/lib/kubelet/pods/45f963ee-4e46-4ee0-aabc-787ad300f43c/volumes" Jul 07 00:07:29.092309 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.092296 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4" path="/var/lib/kubelet/pods/9b1d69f7-7b3d-4abe-9adc-efb9cdda7eb4/volumes" Jul 07 00:07:29.176489 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.176451 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqs77\" (UniqueName: \"kubernetes.io/projected/a230bbfd-ab47-48f4-9eb8-a69783834c2e-kube-api-access-wqs77\") pod \"a230bbfd-ab47-48f4-9eb8-a69783834c2e\" (UID: \"a230bbfd-ab47-48f4-9eb8-a69783834c2e\") " Jul 07 00:07:29.178680 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.178652 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a230bbfd-ab47-48f4-9eb8-a69783834c2e-kube-api-access-wqs77" (OuterVolumeSpecName: "kube-api-access-wqs77") pod "a230bbfd-ab47-48f4-9eb8-a69783834c2e" (UID: "a230bbfd-ab47-48f4-9eb8-a69783834c2e"). InnerVolumeSpecName "kube-api-access-wqs77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:29.277785 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.277672 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqs77\" (UniqueName: \"kubernetes.io/projected/a230bbfd-ab47-48f4-9eb8-a69783834c2e-kube-api-access-wqs77\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:07:29.681552 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.681468 2549 generic.go:356] "Generic (PLEG): container finished" podID="a230bbfd-ab47-48f4-9eb8-a69783834c2e" containerID="9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a" exitCode=0 Jul 07 00:07:29.681552 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.681505 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5xnbw" Jul 07 00:07:29.681552 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.681535 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5xnbw" event={"ID":"a230bbfd-ab47-48f4-9eb8-a69783834c2e","Type":"ContainerDied","Data":"9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a"} Jul 07 00:07:29.681779 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.681565 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5xnbw" event={"ID":"a230bbfd-ab47-48f4-9eb8-a69783834c2e","Type":"ContainerDied","Data":"560529cbf9f3f8ee79497d5c088c7f9476f740c2de30c75e8e90e3609685f947"} Jul 07 00:07:29.681779 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.681582 2549 scope.go:117] "RemoveContainer" containerID="9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a" Jul 07 00:07:29.690725 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.690706 2549 scope.go:117] "RemoveContainer" containerID="9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a" Jul 07 00:07:29.690971 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:07:29.690954 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a\": container with ID starting with 9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a not found: ID does not exist" containerID="9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a" Jul 07 00:07:29.691027 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.690977 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a"} err="failed to get container status \"9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a\": rpc error: code = NotFound desc = could not find container \"9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a\": container with ID starting with 9b2eeaad439dd4c833a00029d95dd1dfddbc6e2afc5cd36cef703e8736bbdd3a not found: ID does not exist" Jul 07 00:07:29.704098 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.704072 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5xnbw"] Jul 07 00:07:29.713109 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:29.713087 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5xnbw"] Jul 07 00:07:31.091749 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:31.091709 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a230bbfd-ab47-48f4-9eb8-a69783834c2e" path="/var/lib/kubelet/pods/a230bbfd-ab47-48f4-9eb8-a69783834c2e/volumes" Jul 07 00:07:32.966513 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:32.966474 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c8cd9787-qlttj"] Jul 07 00:07:32.966891 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:32.966837 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a230bbfd-ab47-48f4-9eb8-a69783834c2e" containerName="authorino" Jul 07 00:07:32.966891 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:32.966848 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a230bbfd-ab47-48f4-9eb8-a69783834c2e" containerName="authorino" Jul 07 00:07:32.966974 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:32.966926 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a230bbfd-ab47-48f4-9eb8-a69783834c2e" containerName="authorino" Jul 07 00:07:33.168459 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.168423 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.171260 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.171194 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 00:07:33.172432 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.172383 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4f67s\"" Jul 07 00:07:33.172565 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.172390 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 00:07:33.175434 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.175412 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c8cd9787-qlttj"] Jul 07 00:07:33.175562 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.175446 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b6579cb75-skzhn"] Jul 07 00:07:33.198376 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.198351 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b6579cb75-skzhn"] Jul 07 00:07:33.198530 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.198440 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.212262 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.212208 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6vv\" (UniqueName: \"kubernetes.io/projected/1fa640ae-4319-4f5b-974d-d68047550917-kube-api-access-vc6vv\") pod \"maas-controller-7b6579cb75-skzhn\" (UID: \"1fa640ae-4319-4f5b-974d-d68047550917\") " pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.212386 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.212273 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-service-ca\") pod \"maas-controller-8c8cd9787-qlttj\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.212386 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.212311 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fa640ae-4319-4f5b-974d-d68047550917-service-ca\") pod \"maas-controller-7b6579cb75-skzhn\" (UID: \"1fa640ae-4319-4f5b-974d-d68047550917\") " pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.212455 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.212428 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fa640ae-4319-4f5b-974d-d68047550917-webhook-cert\") pod \"maas-controller-7b6579cb75-skzhn\" (UID: \"1fa640ae-4319-4f5b-974d-d68047550917\") " pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.212486 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.212472 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-webhook-cert\") pod \"maas-controller-8c8cd9787-qlttj\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.212599 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.212586 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsbf9\" (UniqueName: \"kubernetes.io/projected/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-kube-api-access-nsbf9\") pod \"maas-controller-8c8cd9787-qlttj\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.313458 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.313366 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fa640ae-4319-4f5b-974d-d68047550917-webhook-cert\") pod \"maas-controller-7b6579cb75-skzhn\" (UID: \"1fa640ae-4319-4f5b-974d-d68047550917\") " pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.313458 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.313410 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-webhook-cert\") pod \"maas-controller-8c8cd9787-qlttj\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.313458 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.313436 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsbf9\" (UniqueName: \"kubernetes.io/projected/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-kube-api-access-nsbf9\") pod \"maas-controller-8c8cd9787-qlttj\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.313458 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.313461 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6vv\" (UniqueName: \"kubernetes.io/projected/1fa640ae-4319-4f5b-974d-d68047550917-kube-api-access-vc6vv\") pod \"maas-controller-7b6579cb75-skzhn\" (UID: \"1fa640ae-4319-4f5b-974d-d68047550917\") " pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.313750 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.313476 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-service-ca\") pod \"maas-controller-8c8cd9787-qlttj\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.313750 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.313675 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fa640ae-4319-4f5b-974d-d68047550917-service-ca\") pod \"maas-controller-7b6579cb75-skzhn\" (UID: \"1fa640ae-4319-4f5b-974d-d68047550917\") " pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.314388 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.314365 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fa640ae-4319-4f5b-974d-d68047550917-service-ca\") pod \"maas-controller-7b6579cb75-skzhn\" (UID: \"1fa640ae-4319-4f5b-974d-d68047550917\") " pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.314493 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.314370 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-service-ca\") pod \"maas-controller-8c8cd9787-qlttj\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.315847 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.315827 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-webhook-cert\") pod \"maas-controller-8c8cd9787-qlttj\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.315930 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.315834 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fa640ae-4319-4f5b-974d-d68047550917-webhook-cert\") pod \"maas-controller-7b6579cb75-skzhn\" (UID: \"1fa640ae-4319-4f5b-974d-d68047550917\") " pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.322493 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.322466 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6vv\" (UniqueName: \"kubernetes.io/projected/1fa640ae-4319-4f5b-974d-d68047550917-kube-api-access-vc6vv\") pod \"maas-controller-7b6579cb75-skzhn\" (UID: \"1fa640ae-4319-4f5b-974d-d68047550917\") " pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.322945 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.322919 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsbf9\" (UniqueName: \"kubernetes.io/projected/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-kube-api-access-nsbf9\") pod \"maas-controller-8c8cd9787-qlttj\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.481325 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.481282 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:33.508109 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.508068 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:33.661624 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.661593 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c8cd9787-qlttj"] Jul 07 00:07:33.664383 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:07:33.664350 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5415e9da_8041_4aeb_bdb8_6ec339ca06f9.slice/crio-f9afec013f434b4875f77befa1b34ad09fa3daad6923be321141fea0f638f0fe WatchSource:0}: Error finding container f9afec013f434b4875f77befa1b34ad09fa3daad6923be321141fea0f638f0fe: Status 404 returned error can't find the container with id f9afec013f434b4875f77befa1b34ad09fa3daad6923be321141fea0f638f0fe Jul 07 00:07:33.692440 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.692336 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b6579cb75-skzhn"] Jul 07 00:07:33.695108 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:07:33.695082 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa640ae_4319_4f5b_974d_d68047550917.slice/crio-24e08c7687a3c914ff442c28e4c38581a7ce96b16a1ccd06ae63aa2898d0405d WatchSource:0}: Error finding container 24e08c7687a3c914ff442c28e4c38581a7ce96b16a1ccd06ae63aa2898d0405d: Status 404 returned error can't find the container with id 24e08c7687a3c914ff442c28e4c38581a7ce96b16a1ccd06ae63aa2898d0405d Jul 07 00:07:33.703902 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.703868 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b6579cb75-skzhn" event={"ID":"1fa640ae-4319-4f5b-974d-d68047550917","Type":"ContainerStarted","Data":"24e08c7687a3c914ff442c28e4c38581a7ce96b16a1ccd06ae63aa2898d0405d"} Jul 07 00:07:33.704993 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:33.704966 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c8cd9787-qlttj" event={"ID":"5415e9da-8041-4aeb-bdb8-6ec339ca06f9","Type":"ContainerStarted","Data":"f9afec013f434b4875f77befa1b34ad09fa3daad6923be321141fea0f638f0fe"} Jul 07 00:07:36.727702 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:36.727657 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b6579cb75-skzhn" event={"ID":"1fa640ae-4319-4f5b-974d-d68047550917","Type":"ContainerStarted","Data":"524c9770d3fb89ad944d5a52565402a5822f928d46c355f9373257276d09206c"} Jul 07 00:07:36.728330 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:36.727778 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:36.729385 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:36.729359 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c8cd9787-qlttj" event={"ID":"5415e9da-8041-4aeb-bdb8-6ec339ca06f9","Type":"ContainerStarted","Data":"28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33"} Jul 07 00:07:36.729538 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:36.729521 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:36.791520 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:36.791462 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b6579cb75-skzhn" podStartSLOduration=1.087494673 podStartE2EDuration="3.791446618s" totalImagesPullingTime="2.703951945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:36.791086224 +0000 UTC m=+564.221506984" watchObservedRunningTime="2026-07-07 00:07:36.791446618 +0000 UTC m=+564.221867357" Jul 07 00:07:36.860785 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:36.860730 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c8cd9787-qlttj" podStartSLOduration=2.11350333 podStartE2EDuration="4.860711288s" totalImagesPullingTime="2.747207958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:36.857198956 +0000 UTC m=+564.287619708" watchObservedRunningTime="2026-07-07 00:07:36.860711288 +0000 UTC m=+564.291132048" Jul 07 00:07:47.740182 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:47.740148 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b6579cb75-skzhn" Jul 07 00:07:47.740643 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:47.740488 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:47.810843 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:47.810808 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c8cd9787-qlttj"] Jul 07 00:07:47.811043 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:47.811020 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8c8cd9787-qlttj" podUID="5415e9da-8041-4aeb-bdb8-6ec339ca06f9" containerName="manager" containerID="cri-o://28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33" gracePeriod=30 Jul 07 00:07:48.059644 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.059619 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:48.139208 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.139167 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-webhook-cert\") pod \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " Jul 07 00:07:48.139437 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.139287 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsbf9\" (UniqueName: \"kubernetes.io/projected/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-kube-api-access-nsbf9\") pod \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " Jul 07 00:07:48.139437 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.139318 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-service-ca\") pod \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\" (UID: \"5415e9da-8041-4aeb-bdb8-6ec339ca06f9\") " Jul 07 00:07:48.139755 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.139717 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "5415e9da-8041-4aeb-bdb8-6ec339ca06f9" (UID: "5415e9da-8041-4aeb-bdb8-6ec339ca06f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:07:48.141409 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.141387 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5415e9da-8041-4aeb-bdb8-6ec339ca06f9" (UID: "5415e9da-8041-4aeb-bdb8-6ec339ca06f9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 00:07:48.141569 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.141548 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-kube-api-access-nsbf9" (OuterVolumeSpecName: "kube-api-access-nsbf9") pod "5415e9da-8041-4aeb-bdb8-6ec339ca06f9" (UID: "5415e9da-8041-4aeb-bdb8-6ec339ca06f9"). InnerVolumeSpecName "kube-api-access-nsbf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:48.240782 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.240740 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsbf9\" (UniqueName: \"kubernetes.io/projected/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-kube-api-access-nsbf9\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:07:48.240782 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.240777 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-service-ca\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:07:48.240782 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.240786 2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5415e9da-8041-4aeb-bdb8-6ec339ca06f9-webhook-cert\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 07 00:07:48.786087 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.786052 2549 generic.go:356] "Generic (PLEG): container finished" podID="5415e9da-8041-4aeb-bdb8-6ec339ca06f9" containerID="28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33" exitCode=0 Jul 07 00:07:48.786544 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.786100 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c8cd9787-qlttj" Jul 07 00:07:48.786544 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.786138 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c8cd9787-qlttj" event={"ID":"5415e9da-8041-4aeb-bdb8-6ec339ca06f9","Type":"ContainerDied","Data":"28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33"} Jul 07 00:07:48.786544 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.786197 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c8cd9787-qlttj" event={"ID":"5415e9da-8041-4aeb-bdb8-6ec339ca06f9","Type":"ContainerDied","Data":"f9afec013f434b4875f77befa1b34ad09fa3daad6923be321141fea0f638f0fe"} Jul 07 00:07:48.786544 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.786219 2549 scope.go:117] "RemoveContainer" containerID="28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33" Jul 07 00:07:48.795601 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.795584 2549 scope.go:117] "RemoveContainer" containerID="28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33" Jul 07 00:07:48.795912 ip-10-0-142-126 kubenswrapper[2549]: E0707 00:07:48.795878 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33\": container with ID starting with 28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33 not found: ID does not exist" containerID="28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33" Jul 07 00:07:48.796007 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.795911 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33"} err="failed to get container status \"28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33\": rpc error: code = NotFound desc = could not find container \"28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33\": container with ID starting with 28bd0fe0c9947f476133a0d499d3b588eaa3cfbec79834d8f030777558d91d33 not found: ID does not exist" Jul 07 00:07:48.809440 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.809409 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c8cd9787-qlttj"] Jul 07 00:07:48.811077 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:48.811057 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8c8cd9787-qlttj"] Jul 07 00:07:49.092064 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:07:49.091988 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5415e9da-8041-4aeb-bdb8-6ec339ca06f9" path="/var/lib/kubelet/pods/5415e9da-8041-4aeb-bdb8-6ec339ca06f9/volumes" Jul 07 00:08:08.618411 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.618375 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-69d77664f-v96hb"] Jul 07 00:08:08.618920 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.618723 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5415e9da-8041-4aeb-bdb8-6ec339ca06f9" containerName="manager" Jul 07 00:08:08.618920 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.618733 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5415e9da-8041-4aeb-bdb8-6ec339ca06f9" containerName="manager" Jul 07 00:08:08.618920 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.618792 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5415e9da-8041-4aeb-bdb8-6ec339ca06f9" containerName="manager" Jul 07 00:08:08.625550 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.625525 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:08.628572 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.628546 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7zzr7\"" Jul 07 00:08:08.629431 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.629416 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 07 00:08:08.639858 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.639830 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69d77664f-v96hb"] Jul 07 00:08:08.723880 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.723832 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f11f3600-826e-430c-bc03-3e2d08143142-openshift-service-ca\") pod \"maas-api-69d77664f-v96hb\" (UID: \"f11f3600-826e-430c-bc03-3e2d08143142\") " pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:08.724076 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.723901 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbqbk\" (UniqueName: \"kubernetes.io/projected/f11f3600-826e-430c-bc03-3e2d08143142-kube-api-access-nbqbk\") pod \"maas-api-69d77664f-v96hb\" (UID: \"f11f3600-826e-430c-bc03-3e2d08143142\") " pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:08.724076 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.723977 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f11f3600-826e-430c-bc03-3e2d08143142-maas-api-tls\") pod \"maas-api-69d77664f-v96hb\" (UID: \"f11f3600-826e-430c-bc03-3e2d08143142\") " pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:08.825417 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.825376 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbqbk\" (UniqueName: \"kubernetes.io/projected/f11f3600-826e-430c-bc03-3e2d08143142-kube-api-access-nbqbk\") pod \"maas-api-69d77664f-v96hb\" (UID: \"f11f3600-826e-430c-bc03-3e2d08143142\") " pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:08.825569 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.825438 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f11f3600-826e-430c-bc03-3e2d08143142-maas-api-tls\") pod \"maas-api-69d77664f-v96hb\" (UID: \"f11f3600-826e-430c-bc03-3e2d08143142\") " pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:08.825569 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.825493 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f11f3600-826e-430c-bc03-3e2d08143142-openshift-service-ca\") pod \"maas-api-69d77664f-v96hb\" (UID: \"f11f3600-826e-430c-bc03-3e2d08143142\") " pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:08.826376 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.826358 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f11f3600-826e-430c-bc03-3e2d08143142-openshift-service-ca\") pod \"maas-api-69d77664f-v96hb\" (UID: \"f11f3600-826e-430c-bc03-3e2d08143142\") " pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:08.828309 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.828283 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f11f3600-826e-430c-bc03-3e2d08143142-maas-api-tls\") pod \"maas-api-69d77664f-v96hb\" (UID: \"f11f3600-826e-430c-bc03-3e2d08143142\") " pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:08.838686 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.838655 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbqbk\" (UniqueName: \"kubernetes.io/projected/f11f3600-826e-430c-bc03-3e2d08143142-kube-api-access-nbqbk\") pod \"maas-api-69d77664f-v96hb\" (UID: \"f11f3600-826e-430c-bc03-3e2d08143142\") " pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:08.935942 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:08.935844 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:09.091663 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:08:09.091631 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11f3600_826e_430c_bc03_3e2d08143142.slice/crio-fc4e37b8330e36242ddc71e05abf47f5ffa51d0a79ce6cadee7a6dce798d0098 WatchSource:0}: Error finding container fc4e37b8330e36242ddc71e05abf47f5ffa51d0a79ce6cadee7a6dce798d0098: Status 404 returned error can't find the container with id fc4e37b8330e36242ddc71e05abf47f5ffa51d0a79ce6cadee7a6dce798d0098 Jul 07 00:08:09.092558 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.092511 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69d77664f-v96hb"] Jul 07 00:08:09.163149 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.163118 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-w4b2d"] Jul 07 00:08:09.167751 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.167728 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" Jul 07 00:08:09.171183 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.171148 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g66jr\"" Jul 07 00:08:09.171333 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.171289 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 00:08:09.181516 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.181490 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-w4b2d"] Jul 07 00:08:09.200385 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.200358 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x5bvj"] Jul 07 00:08:09.203635 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.203610 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" Jul 07 00:08:09.223896 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.223871 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x5bvj"] Jul 07 00:08:09.330881 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.330846 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ceaecf90-ad73-47ec-a225-f7d6682936b0-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x5bvj\" (UID: \"ceaecf90-ad73-47ec-a225-f7d6682936b0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" Jul 07 00:08:09.331066 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.330993 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2100dcb4-9e2e-4972-b0c2-fbc0deec44c6-plugins-config-volume\") pod \"payload-processing-58f86c7798-w4b2d\" (UID: \"2100dcb4-9e2e-4972-b0c2-fbc0deec44c6\") " pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" Jul 07 00:08:09.331066 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.331033 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p2zc\" (UniqueName: \"kubernetes.io/projected/2100dcb4-9e2e-4972-b0c2-fbc0deec44c6-kube-api-access-8p2zc\") pod \"payload-processing-58f86c7798-w4b2d\" (UID: \"2100dcb4-9e2e-4972-b0c2-fbc0deec44c6\") " pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" Jul 07 00:08:09.331066 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.331063 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kns8\" (UniqueName: \"kubernetes.io/projected/ceaecf90-ad73-47ec-a225-f7d6682936b0-kube-api-access-9kns8\") pod \"payload-pre-processing-7964457696-x5bvj\" (UID: \"ceaecf90-ad73-47ec-a225-f7d6682936b0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" Jul 07 00:08:09.431707 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.431667 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kns8\" (UniqueName: \"kubernetes.io/projected/ceaecf90-ad73-47ec-a225-f7d6682936b0-kube-api-access-9kns8\") pod \"payload-pre-processing-7964457696-x5bvj\" (UID: \"ceaecf90-ad73-47ec-a225-f7d6682936b0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" Jul 07 00:08:09.431707 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.431711 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ceaecf90-ad73-47ec-a225-f7d6682936b0-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x5bvj\" (UID: \"ceaecf90-ad73-47ec-a225-f7d6682936b0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" Jul 07 00:08:09.431969 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.431772 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2100dcb4-9e2e-4972-b0c2-fbc0deec44c6-plugins-config-volume\") pod \"payload-processing-58f86c7798-w4b2d\" (UID: \"2100dcb4-9e2e-4972-b0c2-fbc0deec44c6\") " pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" Jul 07 00:08:09.431969 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.431795 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p2zc\" (UniqueName: \"kubernetes.io/projected/2100dcb4-9e2e-4972-b0c2-fbc0deec44c6-kube-api-access-8p2zc\") pod \"payload-processing-58f86c7798-w4b2d\" (UID: \"2100dcb4-9e2e-4972-b0c2-fbc0deec44c6\") " pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" Jul 07 00:08:09.432535 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.432513 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ceaecf90-ad73-47ec-a225-f7d6682936b0-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x5bvj\" (UID: \"ceaecf90-ad73-47ec-a225-f7d6682936b0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" Jul 07 00:08:09.432623 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.432535 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2100dcb4-9e2e-4972-b0c2-fbc0deec44c6-plugins-config-volume\") pod \"payload-processing-58f86c7798-w4b2d\" (UID: \"2100dcb4-9e2e-4972-b0c2-fbc0deec44c6\") " pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" Jul 07 00:08:09.441298 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.441271 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kns8\" (UniqueName: \"kubernetes.io/projected/ceaecf90-ad73-47ec-a225-f7d6682936b0-kube-api-access-9kns8\") pod \"payload-pre-processing-7964457696-x5bvj\" (UID: \"ceaecf90-ad73-47ec-a225-f7d6682936b0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" Jul 07 00:08:09.441423 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.441339 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p2zc\" (UniqueName: \"kubernetes.io/projected/2100dcb4-9e2e-4972-b0c2-fbc0deec44c6-kube-api-access-8p2zc\") pod \"payload-processing-58f86c7798-w4b2d\" (UID: \"2100dcb4-9e2e-4972-b0c2-fbc0deec44c6\") " pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" Jul 07 00:08:09.478823 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.478739 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" Jul 07 00:08:09.515058 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.515021 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" Jul 07 00:08:09.630873 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.630844 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-w4b2d"] Jul 07 00:08:09.633795 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:08:09.633751 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2100dcb4_9e2e_4972_b0c2_fbc0deec44c6.slice/crio-1ad3f8db077fa5b1e80b02926456522be72d851130a78081da612c05313fd2d4 WatchSource:0}: Error finding container 1ad3f8db077fa5b1e80b02926456522be72d851130a78081da612c05313fd2d4: Status 404 returned error can't find the container with id 1ad3f8db077fa5b1e80b02926456522be72d851130a78081da612c05313fd2d4 Jul 07 00:08:09.669767 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.669740 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x5bvj"] Jul 07 00:08:09.672326 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:08:09.672297 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceaecf90_ad73_47ec_a225_f7d6682936b0.slice/crio-013cc7e4742e0ffb1728cb6c5cff08694cccafe8b3c5f9dcdb7a079fbbcb2089 WatchSource:0}: Error finding container 013cc7e4742e0ffb1728cb6c5cff08694cccafe8b3c5f9dcdb7a079fbbcb2089: Status 404 returned error can't find the container with id 013cc7e4742e0ffb1728cb6c5cff08694cccafe8b3c5f9dcdb7a079fbbcb2089 Jul 07 00:08:09.887640 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.887547 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69d77664f-v96hb" event={"ID":"f11f3600-826e-430c-bc03-3e2d08143142","Type":"ContainerStarted","Data":"fc4e37b8330e36242ddc71e05abf47f5ffa51d0a79ce6cadee7a6dce798d0098"} Jul 07 00:08:09.888694 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.888663 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" event={"ID":"ceaecf90-ad73-47ec-a225-f7d6682936b0","Type":"ContainerStarted","Data":"013cc7e4742e0ffb1728cb6c5cff08694cccafe8b3c5f9dcdb7a079fbbcb2089"} Jul 07 00:08:09.889833 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:09.889810 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" event={"ID":"2100dcb4-9e2e-4972-b0c2-fbc0deec44c6","Type":"ContainerStarted","Data":"1ad3f8db077fa5b1e80b02926456522be72d851130a78081da612c05313fd2d4"} Jul 07 00:08:10.897947 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:10.897812 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" event={"ID":"ceaecf90-ad73-47ec-a225-f7d6682936b0","Type":"ContainerStarted","Data":"a530aa87b3dc13aa2855a5818f4077b212e0df2efb9b6c20737f8dc3ecbb518b"} Jul 07 00:08:10.897947 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:10.897906 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" Jul 07 00:08:10.899771 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:10.899720 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" event={"ID":"2100dcb4-9e2e-4972-b0c2-fbc0deec44c6","Type":"ContainerStarted","Data":"49caa39309130aac9ccfdbb18109f19c8aa923b69e1ad38388af1927d18d3b0c"} Jul 07 00:08:10.899984 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:10.899860 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" Jul 07 00:08:10.915956 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:10.915895 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" podStartSLOduration=0.804198552 podStartE2EDuration="1.915872461s" totalImagesPullingTime="1.111673909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:08:10.914007934 +0000 UTC m=+598.344428694" watchObservedRunningTime="2026-07-07 00:08:10.915872461 +0000 UTC m=+598.346293226" Jul 07 00:08:10.930837 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:10.930783 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" podStartSLOduration=0.783779279 podStartE2EDuration="1.930766777s" totalImagesPullingTime="1.146987498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:08:10.92902758 +0000 UTC m=+598.359448341" watchObservedRunningTime="2026-07-07 00:08:10.930766777 +0000 UTC m=+598.361187537" Jul 07 00:08:11.905732 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:11.905688 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69d77664f-v96hb" event={"ID":"f11f3600-826e-430c-bc03-3e2d08143142","Type":"ContainerStarted","Data":"33979ef59ff32d4f37d2bb346e58d9f1b3263a5aafca0eb3e0d0b404125943bc"} Jul 07 00:08:11.906255 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:11.906061 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:11.924802 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:11.924740 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-69d77664f-v96hb" podStartSLOduration=1.7764960410000001 podStartE2EDuration="3.92471993s" totalImagesPullingTime="2.148223889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:08:11.922401328 +0000 UTC m=+599.352822089" watchObservedRunningTime="2026-07-07 00:08:11.92471993 +0000 UTC m=+599.355140691" Jul 07 00:08:13.024402 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:13.024376 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/1.log" Jul 07 00:08:13.026987 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:13.026963 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/1.log" Jul 07 00:08:13.030801 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:13.030779 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gqff_b09bd804-568b-4f7e-9621-e1bd704362d7/ovn-acl-logging/0.log" Jul 07 00:08:13.033774 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:13.033745 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gqff_b09bd804-568b-4f7e-9621-e1bd704362d7/ovn-acl-logging/0.log" Jul 07 00:08:18.921439 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:18.921413 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-69d77664f-v96hb" Jul 07 00:08:21.465676 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:21.465635 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d7d697f67-4qqfh_84dd62bb-f199-475b-bb1b-94e2a6377c0b/authorino/0.log" Jul 07 00:08:21.907722 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:21.907649 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-w4b2d" Jul 07 00:08:21.907722 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:21.907713 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-x5bvj" Jul 07 00:08:25.984210 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:25.984180 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4gm76_137e129f-78a4-4b3d-a66c-0c4a6a8be3a2/manager/0.log" Jul 07 00:08:26.095722 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:26.095697 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-n2fcs_08066484-309d-4671-87f0-19b4efc3fb22/manager/0.log" Jul 07 00:08:26.205605 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:26.205583 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69d77664f-v96hb_f11f3600-826e-430c-bc03-3e2d08143142/maas-api/0.log" Jul 07 00:08:26.319931 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:26.319863 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b6579cb75-skzhn_1fa640ae-4319-4f5b-974d-d68047550917/manager/0.log" Jul 07 00:08:26.434623 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:26.434598 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dlmfl_55e45361-24b9-4b6b-b1cb-1cf9e2d58545/server/0.log" Jul 07 00:08:26.549974 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:26.549943 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-snjdj_f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9/manager/0.log" Jul 07 00:08:26.919931 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:26.919906 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6fc95b89-t9pnr_fab64746-9bce-44c3-b5fe-74ca0ddeeb7e/copy-manifests/0.log" Jul 07 00:08:26.931246 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:26.931197 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6fc95b89-t9pnr_fab64746-9bce-44c3-b5fe-74ca0ddeeb7e/manager/0.log" Jul 07 00:08:27.044506 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:27.044482 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wnn7d_9fb879b0-aaef-41b5-94dd-831f07af0c36/postgres/0.log" Jul 07 00:08:28.328740 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:28.328712 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d7d697f67-4qqfh_84dd62bb-f199-475b-bb1b-94e2a6377c0b/authorino/0.log" Jul 07 00:08:28.442067 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:28.442036 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wvmjd_6363df97-6632-49ee-97e0-21e510e479d7/manager/0.log" Jul 07 00:08:28.781496 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:28.781466 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lw5qr_d3b0f479-1e7c-4b38-b044-d5194b7a4a2a/registry-server/0.log" Jul 07 00:08:28.897081 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:28.897057 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zzcc9_39dcb566-fb12-4f4c-9e4b-516b9be843f3/manager/0.log" Jul 07 00:08:29.687812 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:29.687787 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8d95c48d-jl22x_dc7efb58-c8f6-4064-b71a-ce5c1ecfa397/kube-auth-proxy/0.log" Jul 07 00:08:30.017308 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:30.017214 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x5bvj_ceaecf90-ad73-47ec-a225-f7d6682936b0/payload-pre-processing/0.log" Jul 07 00:08:30.125157 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:30.125128 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-w4b2d_2100dcb4-9e2e-4972-b0c2-fbc0deec44c6/payload-processing/0.log" Jul 07 00:08:30.234487 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:30.234461 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f986b9999-lj82p_996107f2-75f4-4da3-a4d0-5938ed1fc92e/router/0.log" Jul 07 00:08:37.938195 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:37.938112 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wbbmh_15ef6701-761f-4437-a24d-1f8cc1439acb/global-pull-secret-syncer/0.log" Jul 07 00:08:38.039193 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:38.039166 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zv66p_48eb1ac7-d2ec-401c-bd8a-fcf5fa8c11ea/konnectivity-agent/0.log" Jul 07 00:08:38.112202 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:38.112179 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-126.ec2.internal_c484925f8d284c178719cc07b93a5386/haproxy/0.log" Jul 07 00:08:43.159457 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:43.159431 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d7d697f67-4qqfh_84dd62bb-f199-475b-bb1b-94e2a6377c0b/authorino/0.log" Jul 07 00:08:43.194678 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:43.194652 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wvmjd_6363df97-6632-49ee-97e0-21e510e479d7/manager/0.log" Jul 07 00:08:43.295241 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:43.295201 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lw5qr_d3b0f479-1e7c-4b38-b044-d5194b7a4a2a/registry-server/0.log" Jul 07 00:08:43.327560 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:43.327525 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zzcc9_39dcb566-fb12-4f4c-9e4b-516b9be843f3/manager/0.log" Jul 07 00:08:45.395465 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:45.395390 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-dtr5b_9deeccd6-365c-43a1-b6d9-d564a21cde0a/cluster-monitoring-operator/0.log" Jul 07 00:08:45.831382 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:45.831355 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7kqb_73c01621-05ab-461c-8a25-3b2180010703/node-exporter/0.log" Jul 07 00:08:45.860038 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:45.860015 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7kqb_73c01621-05ab-461c-8a25-3b2180010703/kube-rbac-proxy/0.log" Jul 07 00:08:45.883487 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:45.883464 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7kqb_73c01621-05ab-461c-8a25-3b2180010703/init-textfile/0.log" Jul 07 00:08:48.146973 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.146936 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t"] Jul 07 00:08:48.152160 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.152140 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.154855 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.154827 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kbm2c\"/\"kube-root-ca.crt\"" Jul 07 00:08:48.154960 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.154874 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kbm2c\"/\"openshift-service-ca.crt\"" Jul 07 00:08:48.154960 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.154903 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kbm2c\"/\"default-dockercfg-sw9sw\"" Jul 07 00:08:48.162440 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.162420 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t"] Jul 07 00:08:48.258489 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.258460 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7skzv\" (UniqueName: \"kubernetes.io/projected/5fbee042-84a9-4a0c-8ee8-7970a85d730b-kube-api-access-7skzv\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.258636 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.258496 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-sys\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.258636 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.258574 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-podres\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.258636 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.258632 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-proc\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.258740 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.258664 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-lib-modules\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.359278 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.359243 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-podres\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.359432 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.359313 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-proc\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.359432 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.359351 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-lib-modules\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.359432 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.359365 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-podres\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.359576 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.359442 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-proc\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.359576 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.359481 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7skzv\" (UniqueName: \"kubernetes.io/projected/5fbee042-84a9-4a0c-8ee8-7970a85d730b-kube-api-access-7skzv\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.359576 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.359513 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-sys\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.359576 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.359490 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-lib-modules\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.359716 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.359588 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fbee042-84a9-4a0c-8ee8-7970a85d730b-sys\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.367694 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.367666 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7skzv\" (UniqueName: \"kubernetes.io/projected/5fbee042-84a9-4a0c-8ee8-7970a85d730b-kube-api-access-7skzv\") pod \"perf-node-gather-daemonset-rl96t\" (UID: \"5fbee042-84a9-4a0c-8ee8-7970a85d730b\") " pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.426366 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.426310 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/1.log" Jul 07 00:08:48.430674 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.430659 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjfjg_cd9d5c53-ba09-4586-a544-88ea6352bb0c/console-operator/2.log" Jul 07 00:08:48.462264 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.462220 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:48.588646 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:48.588625 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t"] Jul 07 00:08:48.590715 ip-10-0-142-126 kubenswrapper[2549]: W0707 00:08:48.590687 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5fbee042_84a9_4a0c_8ee8_7970a85d730b.slice/crio-3fc21aa18baff8014a56d9b5f2db38965d761a391e21ce892ddac359c6277e02 WatchSource:0}: Error finding container 3fc21aa18baff8014a56d9b5f2db38965d761a391e21ce892ddac359c6277e02: Status 404 returned error can't find the container with id 3fc21aa18baff8014a56d9b5f2db38965d761a391e21ce892ddac359c6277e02 Jul 07 00:08:49.084854 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:49.084818 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" event={"ID":"5fbee042-84a9-4a0c-8ee8-7970a85d730b","Type":"ContainerStarted","Data":"d11cbd98e2bb0be1a32f87f3907eb8a4bb2a6d98179e1a2b2591cccc9f77a819"} Jul 07 00:08:49.085048 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:49.084871 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" event={"ID":"5fbee042-84a9-4a0c-8ee8-7970a85d730b","Type":"ContainerStarted","Data":"3fc21aa18baff8014a56d9b5f2db38965d761a391e21ce892ddac359c6277e02"} Jul 07 00:08:49.085048 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:49.084906 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:49.105161 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:49.105119 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" podStartSLOduration=1.105106138 podStartE2EDuration="1.105106138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:08:49.10448918 +0000 UTC m=+636.534909932" watchObservedRunningTime="2026-07-07 00:08:49.105106138 +0000 UTC m=+636.535526898" Jul 07 00:08:49.657257 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:49.657212 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-4dc4w_7674237c-9c02-45a9-bcef-6418a5da70f3/volume-data-source-validator/0.log" Jul 07 00:08:50.749911 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:50.749881 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4lc7t_56c9a5c2-3cfd-4d15-a61a-9831990f5e1b/dns/0.log" Jul 07 00:08:50.777206 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:50.777183 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4lc7t_56c9a5c2-3cfd-4d15-a61a-9831990f5e1b/kube-rbac-proxy/0.log" Jul 07 00:08:50.957837 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:50.957806 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p99kk_0ef8a894-bebe-4f5e-a93a-4ad0f902e528/dns-node-resolver/0.log" Jul 07 00:08:51.555271 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:51.555244 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4t2b6_9cab9320-c9c9-438c-816c-ee36d5177062/node-ca/0.log" Jul 07 00:08:52.717129 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:52.717100 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8d95c48d-jl22x_dc7efb58-c8f6-4064-b71a-ce5c1ecfa397/kube-auth-proxy/0.log" Jul 07 00:08:52.799886 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:52.799857 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x5bvj_ceaecf90-ad73-47ec-a225-f7d6682936b0/payload-pre-processing/0.log" Jul 07 00:08:52.828863 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:52.828835 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-w4b2d_2100dcb4-9e2e-4972-b0c2-fbc0deec44c6/payload-processing/0.log" Jul 07 00:08:52.860561 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:52.860538 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f986b9999-lj82p_996107f2-75f4-4da3-a4d0-5938ed1fc92e/router/0.log" Jul 07 00:08:53.488332 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:53.488300 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6r5fx_6e672cde-60c3-4c2e-a162-6487f41171bc/serve-healthcheck-canary/0.log" Jul 07 00:08:54.037011 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:54.036979 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-fpxq2_5635d7b0-c65d-47a3-9b86-ca1a0f059d25/insights-operator/1.log" Jul 07 00:08:54.037491 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:54.037477 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-fpxq2_5635d7b0-c65d-47a3-9b86-ca1a0f059d25/insights-operator/0.log" Jul 07 00:08:54.070903 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:54.070884 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6w7qf_be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c/kube-rbac-proxy/0.log" Jul 07 00:08:54.098421 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:54.098402 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6w7qf_be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c/exporter/0.log" Jul 07 00:08:54.128127 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:54.128111 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6w7qf_be22bfbc-a0b7-441d-80e0-a13c5ca0dd3c/extractor/0.log" Jul 07 00:08:55.099735 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:55.099710 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kbm2c/perf-node-gather-daemonset-rl96t" Jul 07 00:08:56.631583 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:56.631552 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4gm76_137e129f-78a4-4b3d-a66c-0c4a6a8be3a2/manager/0.log" Jul 07 00:08:56.673724 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:56.673688 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-n2fcs_08066484-309d-4671-87f0-19b4efc3fb22/manager/0.log" Jul 07 00:08:56.702071 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:56.702047 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69d77664f-v96hb_f11f3600-826e-430c-bc03-3e2d08143142/maas-api/0.log" Jul 07 00:08:56.736064 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:56.736041 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b6579cb75-skzhn_1fa640ae-4319-4f5b-974d-d68047550917/manager/0.log" Jul 07 00:08:56.762112 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:56.762092 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dlmfl_55e45361-24b9-4b6b-b1cb-1cf9e2d58545/server/0.log" Jul 07 00:08:56.808433 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:56.808416 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-snjdj_f9dd76d3-a0e4-4d38-b47d-de1dfc72a4b9/manager/0.log" Jul 07 00:08:56.959065 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:56.959041 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6fc95b89-t9pnr_fab64746-9bce-44c3-b5fe-74ca0ddeeb7e/manager/0.log" Jul 07 00:08:56.978010 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:56.977992 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6fc95b89-t9pnr_fab64746-9bce-44c3-b5fe-74ca0ddeeb7e/copy-manifests/0.log" Jul 07 00:08:57.009005 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:57.008989 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wnn7d_9fb879b0-aaef-41b5-94dd-831f07af0c36/postgres/0.log" Jul 07 00:08:58.472573 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:58.472545 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8d95c48d-jl22x_dc7efb58-c8f6-4064-b71a-ce5c1ecfa397/kube-auth-proxy/0.log" Jul 07 00:08:58.515159 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:58.515128 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x5bvj_ceaecf90-ad73-47ec-a225-f7d6682936b0/payload-pre-processing/0.log" Jul 07 00:08:58.528744 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:58.528720 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-w4b2d_2100dcb4-9e2e-4972-b0c2-fbc0deec44c6/payload-processing/0.log" Jul 07 00:08:58.547559 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:58.547535 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f986b9999-lj82p_996107f2-75f4-4da3-a4d0-5938ed1fc92e/router/0.log" Jul 07 00:08:59.670406 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:59.670380 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8d95c48d-jl22x_dc7efb58-c8f6-4064-b71a-ce5c1ecfa397/kube-auth-proxy/0.log" Jul 07 00:08:59.723455 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:59.723389 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x5bvj_ceaecf90-ad73-47ec-a225-f7d6682936b0/payload-pre-processing/0.log" Jul 07 00:08:59.740625 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:59.740602 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-w4b2d_2100dcb4-9e2e-4972-b0c2-fbc0deec44c6/payload-processing/0.log" Jul 07 00:08:59.761144 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:08:59.761126 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f986b9999-lj82p_996107f2-75f4-4da3-a4d0-5938ed1fc92e/router/0.log" Jul 07 00:09:03.799206 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:03.799180 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-hlhtl_182215b6-8b23-4f4e-bb64-2302a1b08eae/kube-storage-version-migrator-operator/1.log" Jul 07 00:09:03.800305 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:03.800208 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-hlhtl_182215b6-8b23-4f4e-bb64-2302a1b08eae/kube-storage-version-migrator-operator/0.log" Jul 07 00:09:04.960038 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:04.960008 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nh8b_36f35e1e-7949-4839-918c-d20509e3bb21/kube-multus-additional-cni-plugins/0.log" Jul 07 00:09:04.984437 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:04.984414 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nh8b_36f35e1e-7949-4839-918c-d20509e3bb21/egress-router-binary-copy/0.log" Jul 07 00:09:05.007855 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:05.007832 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nh8b_36f35e1e-7949-4839-918c-d20509e3bb21/cni-plugins/0.log" Jul 07 00:09:05.032285 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:05.032264 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nh8b_36f35e1e-7949-4839-918c-d20509e3bb21/bond-cni-plugin/0.log" Jul 07 00:09:05.055985 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:05.055963 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nh8b_36f35e1e-7949-4839-918c-d20509e3bb21/routeoverride-cni/0.log" Jul 07 00:09:05.081897 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:05.081878 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nh8b_36f35e1e-7949-4839-918c-d20509e3bb21/whereabouts-cni-bincopy/0.log" Jul 07 00:09:05.108802 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:05.108780 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nh8b_36f35e1e-7949-4839-918c-d20509e3bb21/whereabouts-cni/0.log" Jul 07 00:09:05.345807 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:05.345738 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g5txc_084780e8-838d-4a25-b9c0-555ac609e13b/kube-multus/0.log" Jul 07 00:09:05.531188 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:05.531164 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w2rnb_c8505f9f-9105-4006-91d2-5455cfe622a6/network-metrics-daemon/0.log" Jul 07 00:09:05.553862 ip-10-0-142-126 kubenswrapper[2549]: I0707 00:09:05.553837 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w2rnb_c8505f9f-9105-4006-91d2-5455cfe622a6/kube-rbac-proxy/0.log"