Jul 13 07:11:49.348953 ip-10-0-132-188 systemd[1]: Starting Kubernetes Kubelet... Jul 13 07:11:49.807350 ip-10-0-132-188 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 07:11:49.807350 ip-10-0-132-188 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 07:11:49.807350 ip-10-0-132-188 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 07:11:49.807350 ip-10-0-132-188 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 07:11:49.807350 ip-10-0-132-188 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 07:11:49.809496 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.809401 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 07:11:49.816773 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816735 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:11:49.816773 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816764 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:11:49.816773 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816769 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:11:49.816773 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816772 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:11:49.816773 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816777 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:11:49.816773 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816779 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:11:49.816773 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816782 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:11:49.816773 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816786 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:11:49.816773 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816789 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816792 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816797 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816801 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816804 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816806 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816809 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816812 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816815 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816817 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816820 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816822 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816825 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816831 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816833 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816836 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816839 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816841 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816843 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816846 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:11:49.817116 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816849 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816851 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816854 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816856 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816858 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816861 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816864 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816866 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816868 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816871 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816873 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816875 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816879 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816881 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816885 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816888 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816890 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816892 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816895 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816897 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:11:49.817602 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816900 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816903 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816917 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816920 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816922 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816925 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816927 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816930 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816932 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816935 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816937 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816940 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816944 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816949 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816952 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816955 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816959 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816962 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816964 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:11:49.818161 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816966 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816969 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816971 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816974 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816976 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816979 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816981 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816985 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816988 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816990 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816993 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816996 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.816998 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817001 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817003 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817005 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817014 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817017 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817019 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817022 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:11:49.818645 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817024 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817027 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817029 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817032 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817044 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817047 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817049 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817052 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817056 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817059 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817062 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817064 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817873 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817881 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817884 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817887 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817889 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817894 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817897 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:11:49.819142 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817901 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817905 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817908 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817911 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817914 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817917 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817920 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817923 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817925 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817928 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817933 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817937 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817940 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817943 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817945 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817948 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817951 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817953 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817956 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817959 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:11:49.819637 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817961 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817964 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817967 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817970 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817973 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817975 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817978 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817981 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817984 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817987 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817990 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817993 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.817997 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818000 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818002 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818005 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818008 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818011 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818013 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818016 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:11:49.820140 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818018 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818021 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818024 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818026 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818029 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818031 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818033 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818036 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818038 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818041 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818043 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818046 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818048 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818051 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818053 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818057 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818061 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818064 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818067 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:11:49.820657 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818069 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818072 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818074 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818077 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818079 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818082 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818085 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818088 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818090 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818093 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818095 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818097 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818100 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818103 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818106 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818108 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818111 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818114 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818116 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818118 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:11:49.821139 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818121 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818124 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818126 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818129 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818131 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818133 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818136 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818139 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818143 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818145 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818148 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818151 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818154 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818572 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818577 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818580 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818583 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818629 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818633 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818636 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:11:49.821682 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818640 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818642 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818645 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818650 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818653 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818656 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818660 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818663 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818666 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818670 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818673 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818676 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818678 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818681 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818684 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818687 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818689 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818692 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818695 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:11:49.822280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818697 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818700 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818702 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818706 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818708 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818711 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818714 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818716 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818719 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818722 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818724 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818727 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818729 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818733 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818736 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818739 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818741 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818744 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818746 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818749 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:11:49.822779 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818752 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818755 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818757 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818765 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818767 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818770 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818772 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818774 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818777 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818779 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818781 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818787 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818789 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818792 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818794 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818797 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818802 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818805 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818807 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818810 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:11:49.823323 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818812 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818815 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818820 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818823 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818826 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818829 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818832 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818835 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818838 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818841 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818844 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818847 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818850 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818852 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818854 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818857 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818865 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818868 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818870 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:11:49.823828 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818872 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818875 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818877 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818880 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818882 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818884 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818887 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818889 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818892 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818895 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818898 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818900 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818903 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.818905 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.818991 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819003 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819012 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819019 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819025 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819030 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819036 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819043 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 07:11:49.824302 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819048 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819051 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819058 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819062 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819064 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819067 2561 flags.go:64] FLAG: --cgroup-root="" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819070 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819073 2561 flags.go:64] FLAG: --client-ca-file="" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819081 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819085 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819090 2561 flags.go:64] FLAG: --cluster-domain="" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819093 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819096 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819099 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819103 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819107 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819110 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819113 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819116 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819121 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819124 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819127 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819130 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819133 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 07:11:49.824888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819138 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819140 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819143 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819146 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819149 2561 flags.go:64] FLAG: --enable-server="true" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819152 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819158 2561 flags.go:64] FLAG: --event-burst="100" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819161 2561 flags.go:64] FLAG: --event-qps="50" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819164 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819167 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819171 2561 flags.go:64] FLAG: --eviction-hard="" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819175 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819177 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819180 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819183 2561 flags.go:64] FLAG: --eviction-soft="" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819186 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819189 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819193 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819196 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819199 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819202 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819205 2561 flags.go:64] FLAG: --feature-gates="" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819208 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819212 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819215 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 07:11:49.825461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819217 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819220 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819225 2561 flags.go:64] FLAG: --help="false" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819227 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-132-188.ec2.internal" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819231 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819234 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819236 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819250 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819254 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819258 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819260 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819263 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819266 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819269 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819272 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819275 2561 flags.go:64] FLAG: --kube-reserved="" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819278 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819282 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819285 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819288 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819290 2561 flags.go:64] FLAG: --lock-file="" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819293 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819296 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819299 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 07:11:49.826112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819305 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819315 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819318 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819320 2561 flags.go:64] FLAG: --logging-format="text" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819323 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819327 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819330 2561 flags.go:64] FLAG: --manifest-url="" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819333 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819337 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819340 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819346 2561 flags.go:64] FLAG: --max-pods="110" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819348 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819351 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819354 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819357 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819360 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819363 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819366 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819374 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819377 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819380 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819383 2561 flags.go:64] FLAG: --pod-cidr="" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819385 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 07:11:49.826804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819391 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819394 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819399 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819402 2561 flags.go:64] FLAG: --port="10250" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819405 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819408 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0492aedca3cb6df30" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819411 2561 flags.go:64] FLAG: --qos-reserved="" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819413 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819417 2561 flags.go:64] FLAG: --register-node="true" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819420 2561 flags.go:64] FLAG: --register-with-taints="" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819423 2561 flags.go:64] FLAG: --registry-burst="10" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819432 2561 flags.go:64] FLAG: --registry-qps="5" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819435 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819438 2561 flags.go:64] FLAG: --reserved-memory="" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819442 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819445 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819448 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819450 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819453 2561 flags.go:64] FLAG: --runonce="false" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819456 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819460 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819463 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819466 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819469 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819472 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819475 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 07:11:49.827403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819477 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819481 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819483 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819486 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819489 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819492 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819495 2561 flags.go:64] FLAG: --system-cgroups="" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819498 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819505 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819507 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819510 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819515 2561 flags.go:64] FLAG: --tls-min-version="" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819517 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819520 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819523 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819525 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819528 2561 flags.go:64] FLAG: --v="2" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819532 2561 flags.go:64] FLAG: --version="false" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819537 2561 flags.go:64] FLAG: --vmodule="" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819541 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.819544 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819705 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819709 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819712 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:11:49.828065 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819715 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819718 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819722 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819725 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819727 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819730 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819733 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819735 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819738 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819740 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819743 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819747 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819750 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819754 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819756 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819759 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819763 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819765 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819768 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819770 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:11:49.828716 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819773 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819776 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819778 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819781 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819784 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819787 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819789 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819793 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819796 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819798 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819801 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819803 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819805 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819808 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819811 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819814 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819817 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819820 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819822 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819825 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:11:49.829214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819827 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819829 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819832 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819834 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819837 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819839 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819842 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819844 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819848 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819850 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819853 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819855 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819858 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819860 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819863 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819865 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819868 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819871 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819874 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819876 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:11:49.829729 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819880 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819882 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819885 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819887 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819890 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819892 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819896 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819899 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819901 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819904 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819906 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819909 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819911 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819914 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819916 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819919 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819922 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819924 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819927 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:11:49.830227 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819929 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819934 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819936 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819939 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819941 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819944 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819948 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819952 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819955 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819957 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819960 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819963 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819967 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819969 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819972 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819975 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:11:49.830733 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.819979 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.820780 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.828431 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.828454 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.829408 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.829418 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829489 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829495 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829498 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829501 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829506 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829510 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829513 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829516 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:11:49.831125 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829519 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829522 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829525 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829527 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829530 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829532 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829535 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829537 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829540 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829543 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829545 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829548 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829550 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829553 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829555 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829558 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829560 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829563 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829565 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829568 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:11:49.831501 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829571 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829575 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829577 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829580 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829583 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829586 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829588 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829590 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829593 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829595 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829598 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829601 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829605 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829608 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829623 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829625 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829628 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829631 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829633 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:11:49.832027 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829636 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829638 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829641 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829644 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829646 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829649 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829651 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829654 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829656 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829660 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829663 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829665 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829668 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829671 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829674 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829679 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829682 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829685 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829687 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:11:49.832496 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829690 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829693 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829695 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829698 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829700 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829703 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829706 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829708 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829710 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829713 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829715 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829718 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829720 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829723 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829725 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829728 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829730 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829733 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829736 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829739 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:11:49.832982 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829743 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829746 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829748 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829751 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829753 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829756 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829759 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829761 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829764 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829766 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829769 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829771 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829774 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.829779 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829933 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:11:49.833508 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829938 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829941 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829943 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829946 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829948 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829951 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829954 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829956 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829958 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829961 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829963 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829966 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829968 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829971 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829974 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829976 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829980 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829984 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829987 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:11:49.833922 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829990 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829993 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829996 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.829998 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830001 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830003 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830005 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830008 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830016 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830019 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830021 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830023 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830025 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830028 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830030 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830032 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830035 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830038 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830041 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:11:49.834388 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830044 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830047 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830049 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830052 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830055 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830057 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830060 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830062 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830065 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830068 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830070 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830073 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830076 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830079 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830082 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830084 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830087 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830089 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830092 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830094 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:11:49.834999 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830097 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830099 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830107 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830110 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830112 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830115 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830117 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830119 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830122 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830124 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830126 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830129 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830132 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830134 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830136 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830139 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830142 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830145 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830148 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830150 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:11:49.835509 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830153 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830155 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830158 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830161 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830163 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830166 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830168 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830171 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830173 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830176 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830178 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830180 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830183 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830185 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830188 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830196 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830198 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830201 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830204 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:11:49.836076 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:49.830206 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:11:49.836547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.830211 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 07:11:49.836547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.830357 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 07:11:49.836547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.832943 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 07:11:49.836547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.834521 2561 server.go:1019] "Starting client certificate rotation" Jul 13 07:11:49.836547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.834649 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 07:11:49.836547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.834696 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 07:11:49.838283 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.838259 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 07:11:49.840172 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.840155 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 07:11:49.851310 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.851284 2561 log.go:25] "Validated CRI v1 runtime API" Jul 13 07:11:49.854565 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.854540 2561 log.go:25] "Validated CRI v1 image API" Jul 13 07:11:49.855499 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.855478 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 07:11:49.858295 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.858268 2561 fs.go:135] Filesystem UUIDs: map[69e028f2-2ff7-4851-acb6-4e9d48d65653:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e645e3bf-3cf5-4653-8d53-fd88b834e569:/dev/nvme0n1p3] Jul 13 07:11:49.858383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.858293 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 07:11:49.863504 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.863367 2561 manager.go:216] Machine: {Timestamp:2026-07-13 07:11:49.86284401 +0000 UTC m=+0.384065964 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090334 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23903bf71cfde3478c8b7e8c4d06d8 SystemUUID:ec23903b-f71c-fde3-478c-8b7e8c4d06d8 BootID:90df0d4a-0fd0-4e1c-8ca0-b2f062580221 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8f:12:43:99:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8f:12:43:99:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:06:4f:e3:f7:0d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 07:11:49.863504 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.863484 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 07:11:49.863714 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.863595 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 07:11:49.867225 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.867189 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 07:11:49.867382 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.867228 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-188.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 07:11:49.868106 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.868095 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 07:11:49.868147 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.868109 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 07:11:49.868147 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.868117 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 07:11:49.868147 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.868131 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 07:11:49.869809 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.869797 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 07:11:49.874093 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.874072 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 13 07:11:49.874256 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.874245 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 07:11:49.875036 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.875026 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 13 07:11:49.875083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.875041 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 07:11:49.875083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.875073 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 07:11:49.875083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.875083 2561 kubelet.go:398] "Adding apiserver pod source" Jul 13 07:11:49.875207 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.875099 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 07:11:49.875659 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.875644 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 07:11:49.875719 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.875673 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 07:11:49.878580 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.878562 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 07:11:49.881017 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.880991 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 07:11:49.881165 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881023 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 07:11:49.881165 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881075 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 07:11:49.881315 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881301 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 07:11:49.881363 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881322 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 07:11:49.881363 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881329 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 07:11:49.881363 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881334 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 07:11:49.881363 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881343 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 07:11:49.881363 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881350 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 07:11:49.881955 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881943 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 07:11:49.881955 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881955 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 07:11:49.882020 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881962 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 07:11:49.882020 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881968 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 07:11:49.882020 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881977 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 07:11:49.882020 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.881987 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 07:11:49.882958 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.882947 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 07:11:49.882958 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.882957 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 07:11:49.886790 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.886769 2561 server.go:1268] "Started kubelet" Jul 13 07:11:49.890365 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.886914 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 07:11:49.890365 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.890308 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 07:11:49.890515 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.890413 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 07:11:49.891433 ip-10-0-132-188 systemd[1]: Started Kubernetes Kubelet. Jul 13 07:11:49.891633 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.891433 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 07:11:49.891795 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.891732 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-188.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 07:11:49.892002 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.891947 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 07:11:49.892592 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.892266 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 07:11:49.893968 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.893946 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 13 07:11:49.896951 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.896927 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 07:11:49.900896 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.900876 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 07:11:49.900896 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.900884 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 07:11:49.901110 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.901077 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-188.ec2.internal\" not found" Jul 13 07:11:49.901866 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.901637 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 07:11:49.901866 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.901647 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 07:11:49.901866 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.901665 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 07:11:49.901866 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.901821 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 13 07:11:49.901866 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.901830 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 13 07:11:49.902715 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.902698 2561 factory.go:55] Registering systemd factory Jul 13 07:11:49.902775 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.902745 2561 factory.go:223] Registration of the systemd container factory successfully Jul 13 07:11:49.903032 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.903015 2561 factory.go:153] Registering CRI-O factory Jul 13 07:11:49.903084 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.903036 2561 factory.go:223] Registration of the crio container factory successfully Jul 13 07:11:49.903118 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.903103 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 07:11:49.903174 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.903134 2561 factory.go:103] Registering Raw factory Jul 13 07:11:49.903174 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.903148 2561 manager.go:1196] Started watching for new ooms in manager Jul 13 07:11:49.904243 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.904228 2561 manager.go:349] Starting recovery of all containers Jul 13 07:11:49.907584 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.907552 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 07:11:49.907752 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.907723 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 07:11:49.908946 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.907658 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e418214924 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.88673258 +0000 UTC m=+0.407954536,LastTimestamp:2026-07-13 07:11:49.88673258 +0000 UTC m=+0.407954536,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:49.915003 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.914831 2561 manager.go:354] Recovery completed Jul 13 07:11:49.919001 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.918989 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:11:49.921084 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.921062 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:11:49.921190 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.921103 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:11:49.921190 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.921119 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:11:49.921699 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.921681 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 07:11:49.921699 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.921696 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 07:11:49.921810 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.921711 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 13 07:11:49.921810 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.921686 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:11:49.922554 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.922537 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:11:49.922675 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.922570 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:11:49.922675 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.922581 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:11:49.923058 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.923041 2561 policy_none.go:49] "None policy: Start" Jul 13 07:11:49.923058 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.923061 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 07:11:49.923152 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.923074 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 07:11:49.923933 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.923840 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e41a2d70ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-188.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.921083564 +0000 UTC m=+0.442305519,LastTimestamp:2026-07-13 07:11:49.921083564 +0000 UTC m=+0.442305519,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:49.924264 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.924250 2561 policy_none.go:47] "Start" Jul 13 07:11:49.943993 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.943882 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e41a2dde1d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-188.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.921111581 +0000 UTC m=+0.442333537,LastTimestamp:2026-07-13 07:11:49.921111581 +0000 UTC m=+0.442333537,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:49.966600 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.966517 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e41a2e0e42 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-188.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.921123906 +0000 UTC m=+0.442345861,LastTimestamp:2026-07-13 07:11:49.921123906 +0000 UTC m=+0.442345861,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:49.973892 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.967335 2561 manager.go:337] "Starting Device Plugin manager" Jul 13 07:11:49.973892 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.967368 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 07:11:49.973892 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.967380 2561 server.go:87] "Starting device plugin registration server" Jul 13 07:11:49.973892 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.967679 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 07:11:49.973892 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.967692 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 07:11:49.973892 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.967774 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 07:11:49.973892 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.967884 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 07:11:49.973892 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:49.967892 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 07:11:49.973892 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.968528 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 07:11:49.973892 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.968568 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-188.ec2.internal\" not found" Jul 13 07:11:49.990919 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:49.990832 2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-188.ec2.internal.18c1c7e41a2d70ac\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e41a2d70ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-188.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.921083564 +0000 UTC m=+0.442305519,LastTimestamp:2026-07-13 07:11:49.922554845 +0000 UTC m=+0.443776802,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:50.008562 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.008470 2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-188.ec2.internal.18c1c7e41a2dde1d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e41a2dde1d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-188.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.921111581 +0000 UTC m=+0.442333537,LastTimestamp:2026-07-13 07:11:49.92257569 +0000 UTC m=+0.443797645,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:50.012919 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.012890 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 07:11:50.014294 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.014273 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 07:11:50.014380 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.014322 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 07:11:50.014380 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.014347 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 07:11:50.014461 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.014389 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 07:11:50.019709 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.019686 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jul 13 07:11:50.019804 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.019676 2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-188.ec2.internal.18c1c7e41a2e0e42\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e41a2e0e42 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-188.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.921123906 +0000 UTC m=+0.442345861,LastTimestamp:2026-07-13 07:11:49.922584819 +0000 UTC m=+0.443806773,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:50.032560 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.032477 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e41d138877 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.969717367 +0000 UTC m=+0.490939308,LastTimestamp:2026-07-13 07:11:49.969717367 +0000 UTC m=+0.490939308,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:50.068694 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.068631 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:11:50.069868 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.069847 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:11:50.069985 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.069885 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:11:50.069985 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.069898 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:11:50.069985 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.069929 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.079172 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.079074 2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-188.ec2.internal.18c1c7e41a2d70ac\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e41a2d70ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-188.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.921083564 +0000 UTC m=+0.442305519,LastTimestamp:2026-07-13 07:11:50.069868414 +0000 UTC m=+0.591090376,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:50.081277 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.081202 2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-188.ec2.internal.18c1c7e41a2dde1d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e41a2dde1d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-188.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.921111581 +0000 UTC m=+0.442333537,LastTimestamp:2026-07-13 07:11:50.069891957 +0000 UTC m=+0.591113913,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:50.081553 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.081527 2561 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.100937 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.100905 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zcplp" Jul 13 07:11:50.104067 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.103987 2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-188.ec2.internal.18c1c7e41a2e0e42\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-188.ec2.internal.18c1c7e41a2e0e42 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-188.ec2.internal,UID:ip-10-0-132-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-188.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-188.ec2.internal,},FirstTimestamp:2026-07-13 07:11:49.921123906 +0000 UTC m=+0.442345861,LastTimestamp:2026-07-13 07:11:50.069903793 +0000 UTC m=+0.591125751,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-188.ec2.internal,}" Jul 13 07:11:50.110064 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.110036 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jul 13 07:11:50.111370 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.111352 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zcplp" Jul 13 07:11:50.114605 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.114585 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal"] Jul 13 07:11:50.114683 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.114673 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:11:50.116194 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.116179 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:11:50.116248 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.116209 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:11:50.116248 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.116220 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:11:50.117481 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.117469 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:11:50.117629 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.117601 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.117682 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.117653 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:11:50.118205 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.118188 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:11:50.118268 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.118221 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:11:50.118268 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.118234 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:11:50.118328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.118188 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:11:50.118328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.118286 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:11:50.118328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.118302 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:11:50.119502 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.119484 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.119602 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.119510 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:11:50.120245 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.120229 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:11:50.120329 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.120258 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:11:50.120329 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.120275 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:11:50.136273 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.136246 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-188.ec2.internal\" not found" node="ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.140260 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.140241 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-188.ec2.internal\" not found" node="ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.203888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.203857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac45b616305bb080e150a9e0a1c57b35-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal\" (UID: \"ac45b616305bb080e150a9e0a1c57b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.203888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.203886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac45b616305bb080e150a9e0a1c57b35-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal\" (UID: \"ac45b616305bb080e150a9e0a1c57b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.204101 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.203905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c35be48bf00c794e91171a7db468cf0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-188.ec2.internal\" (UID: \"5c35be48bf00c794e91171a7db468cf0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.282502 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.282454 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:11:50.283530 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.283510 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:11:50.283648 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.283538 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:11:50.283648 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.283547 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:11:50.283648 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.283578 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.294309 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.294288 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.294420 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.294320 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-188.ec2.internal\": node \"ip-10-0-132-188.ec2.internal\" not found" Jul 13 07:11:50.304022 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.303997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c35be48bf00c794e91171a7db468cf0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-188.ec2.internal\" (UID: \"5c35be48bf00c794e91171a7db468cf0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.304131 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.304025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac45b616305bb080e150a9e0a1c57b35-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal\" (UID: \"ac45b616305bb080e150a9e0a1c57b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.304131 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.304043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac45b616305bb080e150a9e0a1c57b35-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal\" (UID: \"ac45b616305bb080e150a9e0a1c57b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.304131 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.304090 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac45b616305bb080e150a9e0a1c57b35-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal\" (UID: \"ac45b616305bb080e150a9e0a1c57b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.304131 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.304102 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c35be48bf00c794e91171a7db468cf0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-188.ec2.internal\" (UID: \"5c35be48bf00c794e91171a7db468cf0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.304280 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.304163 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac45b616305bb080e150a9e0a1c57b35-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal\" (UID: \"ac45b616305bb080e150a9e0a1c57b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.358456 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.358374 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-188.ec2.internal\" not found" Jul 13 07:11:50.438028 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.437980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.442807 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.442788 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal" Jul 13 07:11:50.459292 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.459257 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-188.ec2.internal\" not found" Jul 13 07:11:50.559990 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.559949 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-188.ec2.internal\" not found" Jul 13 07:11:50.660500 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.660469 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-188.ec2.internal\" not found" Jul 13 07:11:50.761026 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.760985 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-188.ec2.internal\" not found" Jul 13 07:11:50.833520 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.833477 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 07:11:50.861862 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.861822 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-188.ec2.internal\" not found" Jul 13 07:11:50.944815 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.944721 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 07:11:50.962117 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:50.962091 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-188.ec2.internal\" not found" Jul 13 07:11:50.991758 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:50.991722 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 07:11:51.002103 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:51.002059 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" Jul 13 07:11:51.022516 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:51.022488 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 07:11:51.023434 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:51.023419 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal" Jul 13 07:11:51.038964 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:51.038937 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 07:11:51.077563 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:51.077532 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c35be48bf00c794e91171a7db468cf0.slice/crio-f79b409c4fd2398d1bdcb85c014af3e46cdda3996325c46bdf4e2b2abb4b1974 WatchSource:0}: Error finding container f79b409c4fd2398d1bdcb85c014af3e46cdda3996325c46bdf4e2b2abb4b1974: Status 404 returned error can't find the container with id f79b409c4fd2398d1bdcb85c014af3e46cdda3996325c46bdf4e2b2abb4b1974 Jul 13 07:11:51.077794 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:51.077774 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac45b616305bb080e150a9e0a1c57b35.slice/crio-581c1bd333f6305f8728a033dfa00d907d3033f3e577edda135b184b2253f7f3 WatchSource:0}: Error finding container 581c1bd333f6305f8728a033dfa00d907d3033f3e577edda135b184b2253f7f3: Status 404 returned error can't find the container with id 581c1bd333f6305f8728a033dfa00d907d3033f3e577edda135b184b2253f7f3 Jul 13 07:11:51.082796 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:51.082780 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 07:11:51.115073 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:51.115028 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 07:06:51 +0000 UTC" deadline="2028-04-25 16:39:59.261895228 +0000 UTC" Jul 13 07:11:51.115073 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:51.115063 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15657h28m8.146835654s" Jul 13 07:11:52.680636 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:52.680611 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 07:11:52.820248 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:52.820172 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 07:11:53.197578 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.197250 2561 apiserver.go:52] "Watching apiserver" Jul 13 07:11:53.206681 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.206642 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 07:11:53.207243 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.207217 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-tqkbl","openshift-image-registry/node-ca-wstkx","openshift-multus/multus-additional-cni-plugins-ffpgp","openshift-multus/multus-zgz6c","openshift-multus/network-metrics-daemon-k76c6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv","openshift-dns/node-resolver-b2n9c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal","openshift-network-diagnostics/network-check-target-9vmrv","openshift-network-operator/iptables-alerter-xzxgk","openshift-ovn-kubernetes/ovnkube-node-8424l","kube-system/global-pull-secret-syncer-9qtcc","kube-system/konnectivity-agent-gtwrh","kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal"] Jul 13 07:11:53.208867 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.208840 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.210523 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.210503 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.212332 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.212300 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.213455 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.213435 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.214781 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.214760 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:53.214885 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.214835 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:11:53.216162 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.216139 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.218026 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.218000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:11:53.218139 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.218098 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:11:53.219811 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.219779 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.221733 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.221712 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.226333 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.226295 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.227593 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.227563 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 07:11:53.228196 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.228171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:53.228294 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.228263 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:11:53.228378 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.228361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:11:53.231542 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.231511 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 07:11:53.231870 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.231719 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 07:11:53.231870 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.231821 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 07:11:53.231993 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.231825 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 07:11:53.231993 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.231886 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 07:11:53.231993 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.231957 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 07:11:53.232198 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.232182 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 07:11:53.232254 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.232203 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 07:11:53.232427 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.232411 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 07:11:53.232469 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.232419 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 07:11:53.232510 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.232497 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 07:11:53.232667 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.232646 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 07:11:53.232971 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.232953 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:11:53.233048 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.232997 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 07:11:53.233139 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.233121 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zfml9\"" Jul 13 07:11:53.233260 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.233244 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 07:11:53.233326 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.233307 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 07:11:53.233378 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.233354 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8j845\"" Jul 13 07:11:53.233482 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.233246 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 07:11:53.233556 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.233493 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wwjwx\"" Jul 13 07:11:53.233556 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.233500 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvzbt\"" Jul 13 07:11:53.233735 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.233714 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 07:11:53.233855 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.233837 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 07:11:53.235035 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.234204 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 07:11:53.235035 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.234418 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nhb79\"" Jul 13 07:11:53.235035 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.234529 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:11:53.235035 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.234760 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 07:11:53.235035 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.234789 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2dvmw\"" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.237499 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-node-log\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238232 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-kubernetes\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238261 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-systemd\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238274 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6qh8s\"" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238288 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-run-netns\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-device-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp8s8\" (UniqueName: \"kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8\") pod \"network-check-target-9vmrv\" (UID: \"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe\") " pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7a8e5df-db0c-4345-84ab-bd237a9520f1-env-overrides\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238414 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-modprobe-d\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-sysctl-d\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238461 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238470 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfdnn\" (UniqueName: \"kubernetes.io/projected/4b19fff5-4887-4c03-b55e-d3ce73693c53-kube-api-access-wfdnn\") pod \"node-resolver-b2n9c\" (UID: \"4b19fff5-4887-4c03-b55e-d3ce73693c53\") " pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-lib-modules\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238539 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-os-release\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.239083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238561 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-socket-dir-parent\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzt84\" (UniqueName: \"kubernetes.io/projected/afcd192c-f354-497f-a231-fe321f2f1311-kube-api-access-rzt84\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b10be287-71ae-4d80-b703-35f0e3e25842-etc-tuned\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-var-lib-kubelet\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znp9k\" (UniqueName: \"kubernetes.io/projected/e7a8e5df-db0c-4345-84ab-bd237a9520f1-kube-api-access-znp9k\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-slash\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-cni-bin\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-conf-dir\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-run-netns\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7a8e5df-db0c-4345-84ab-bd237a9520f1-ovnkube-config\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afcd192c-f354-497f-a231-fe321f2f1311-cni-binary-copy\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238899 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-run\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-run-k8s-cni-cncf-io\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238943 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-run-multus-certs\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-sys-fs\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.239965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.238989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-system-cni-dir\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-var-lib-cni-multus\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-var-lib-kubelet\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d4vb\" (UniqueName: \"kubernetes.io/projected/28eac7f2-067d-4aa0-a278-94e5e02246e7-kube-api-access-8d4vb\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85a9d402-0dcc-4351-b661-124a897c69fc-iptables-alerter-script\") pod \"iptables-alerter-xzxgk\" (UID: \"85a9d402-0dcc-4351-b661-124a897c69fc\") " pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239170 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-run-systemd\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afcd192c-f354-497f-a231-fe321f2f1311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztkbw\" (UniqueName: \"kubernetes.io/projected/b10be287-71ae-4d80-b703-35f0e3e25842-kube-api-access-ztkbw\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239305 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/447beb12-e780-49da-bf7a-09ecc1ddb5ee-serviceca\") pod \"node-ca-wstkx\" (UID: \"447beb12-e780-49da-bf7a-09ecc1ddb5ee\") " pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b19fff5-4887-4c03-b55e-d3ce73693c53-hosts-file\") pod \"node-resolver-b2n9c\" (UID: \"4b19fff5-4887-4c03-b55e-d3ce73693c53\") " pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7a8e5df-db0c-4345-84ab-bd237a9520f1-ovn-node-metrics-cert\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239398 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b19fff5-4887-4c03-b55e-d3ce73693c53-tmp-dir\") pod \"node-resolver-b2n9c\" (UID: \"4b19fff5-4887-4c03-b55e-d3ce73693c53\") " pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-cnibin\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-daemon-config\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239468 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-run-openvswitch\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.240645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-cnibin\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-etc-kubernetes\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-registration-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a9d402-0dcc-4351-b661-124a897c69fc-host-slash\") pod \"iptables-alerter-xzxgk\" (UID: \"85a9d402-0dcc-4351-b661-124a897c69fc\") " pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-os-release\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-host\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b10be287-71ae-4d80-b703-35f0e3e25842-tmp\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-hostroot\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-system-cni-dir\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5vls\" (UniqueName: \"kubernetes.io/projected/85a9d402-0dcc-4351-b661-124a897c69fc-kube-api-access-v5vls\") pod \"iptables-alerter-xzxgk\" (UID: \"85a9d402-0dcc-4351-b661-124a897c69fc\") " pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-cni-netd\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239885 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239917 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-systemd-units\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-etc-openvswitch\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-run-ovn\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.241337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.239984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afcd192c-f354-497f-a231-fe321f2f1311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240047 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-var-lib-cni-bin\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240099 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-socket-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rkxx\" (UniqueName: \"kubernetes.io/projected/b278b201-14b9-4385-bd96-1217f541d675-kube-api-access-5rkxx\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-sysconfig\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8t7x\" (UniqueName: \"kubernetes.io/projected/447beb12-e780-49da-bf7a-09ecc1ddb5ee-kube-api-access-w8t7x\") pod \"node-ca-wstkx\" (UID: \"447beb12-e780-49da-bf7a-09ecc1ddb5ee\") " pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06a3e42b-393f-4d5e-9db9-b1f9003d7677-cni-binary-copy\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-var-lib-openvswitch\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240249 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-sys\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7a8e5df-db0c-4345-84ab-bd237a9520f1-ovnkube-script-lib\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-kubelet\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-sysctl-conf\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240375 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/447beb12-e780-49da-bf7a-09ecc1ddb5ee-host\") pod \"node-ca-wstkx\" (UID: \"447beb12-e780-49da-bf7a-09ecc1ddb5ee\") " pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-cni-dir\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-log-socket\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.241995 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.240451 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2fxx\" (UniqueName: \"kubernetes.io/projected/06a3e42b-393f-4d5e-9db9-b1f9003d7677-kube-api-access-h2fxx\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.247900 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.247860 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b77bd\"" Jul 13 07:11:53.250408 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.250381 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 07:11:53.250733 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.250711 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cvtq7\"" Jul 13 07:11:53.251095 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.250716 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 07:11:53.281161 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.281133 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 07:11:53.310532 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.310498 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tdqlh" Jul 13 07:11:53.321185 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.321146 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tdqlh" Jul 13 07:11:53.323403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.323380 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 07:11:53.340666 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.340636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-device-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.340849 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.340675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8s8\" (UniqueName: \"kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8\") pod \"network-check-target-9vmrv\" (UID: \"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe\") " pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:11:53.340849 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.340699 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7a8e5df-db0c-4345-84ab-bd237a9520f1-env-overrides\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.340849 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.340738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-modprobe-d\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.340849 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.340794 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-device-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.341051 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.340895 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-modprobe-d\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.341051 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-sysctl-d\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.341051 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfdnn\" (UniqueName: \"kubernetes.io/projected/4b19fff5-4887-4c03-b55e-d3ce73693c53-kube-api-access-wfdnn\") pod \"node-resolver-b2n9c\" (UID: \"4b19fff5-4887-4c03-b55e-d3ce73693c53\") " pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.341224 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.341224 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-kubelet-config\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:53.341224 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341188 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-lib-modules\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.341224 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341198 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-sysctl-d\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.341224 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-os-release\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-socket-dir-parent\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzt84\" (UniqueName: \"kubernetes.io/projected/afcd192c-f354-497f-a231-fe321f2f1311-kube-api-access-rzt84\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b10be287-71ae-4d80-b703-35f0e3e25842-etc-tuned\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341323 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-var-lib-kubelet\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341346 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znp9k\" (UniqueName: \"kubernetes.io/projected/e7a8e5df-db0c-4345-84ab-bd237a9520f1-kube-api-access-znp9k\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-slash\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-cni-bin\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341415 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-conf-dir\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341421 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7a8e5df-db0c-4345-84ab-bd237a9520f1-env-overrides\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341441 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-lib-modules\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.341460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-run-netns\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7a8e5df-db0c-4345-84ab-bd237a9520f1-ovnkube-config\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341530 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-var-lib-kubelet\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afcd192c-f354-497f-a231-fe321f2f1311-cni-binary-copy\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-run\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341583 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-os-release\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-run-k8s-cni-cncf-io\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341646 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-socket-dir-parent\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341631 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-run-multus-certs\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-sys-fs\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341691 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-run-multus-certs\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341694 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-system-cni-dir\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341728 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-system-cni-dir\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-var-lib-cni-multus\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341757 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-var-lib-kubelet\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.341972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341824 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d4vb\" (UniqueName: \"kubernetes.io/projected/28eac7f2-067d-4aa0-a278-94e5e02246e7-kube-api-access-8d4vb\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85a9d402-0dcc-4351-b661-124a897c69fc-iptables-alerter-script\") pod \"iptables-alerter-xzxgk\" (UID: \"85a9d402-0dcc-4351-b661-124a897c69fc\") " pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341931 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-run-systemd\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341955 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341934 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" event={"ID":"ac45b616305bb080e150a9e0a1c57b35","Type":"ContainerStarted","Data":"581c1bd333f6305f8728a033dfa00d907d3033f3e577edda135b184b2253f7f3"} Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.341983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afcd192c-f354-497f-a231-fe321f2f1311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342129 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-sys-fs\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztkbw\" (UniqueName: \"kubernetes.io/projected/b10be287-71ae-4d80-b703-35f0e3e25842-kube-api-access-ztkbw\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342153 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-run\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342167 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-conf-dir\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/447beb12-e780-49da-bf7a-09ecc1ddb5ee-serviceca\") pod \"node-ca-wstkx\" (UID: \"447beb12-e780-49da-bf7a-09ecc1ddb5ee\") " pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342210 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342230 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342278 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-run-netns\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b19fff5-4887-4c03-b55e-d3ce73693c53-hosts-file\") pod \"node-resolver-b2n9c\" (UID: \"4b19fff5-4887-4c03-b55e-d3ce73693c53\") " pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7a8e5df-db0c-4345-84ab-bd237a9520f1-ovn-node-metrics-cert\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b19fff5-4887-4c03-b55e-d3ce73693c53-tmp-dir\") pod \"node-resolver-b2n9c\" (UID: \"4b19fff5-4887-4c03-b55e-d3ce73693c53\") " pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.342813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-cnibin\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342399 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-slash\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-daemon-config\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342448 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-cni-bin\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4632d1eb-0ae2-467d-9f9a-ff61dae76ec2-konnectivity-ca\") pod \"konnectivity-agent-gtwrh\" (UID: \"4632d1eb-0ae2-467d-9f9a-ff61dae76ec2\") " pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342499 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-dbus\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-run-openvswitch\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-cnibin\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-etc-kubernetes\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-registration-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a9d402-0dcc-4351-b661-124a897c69fc-host-slash\") pod \"iptables-alerter-xzxgk\" (UID: \"85a9d402-0dcc-4351-b661-124a897c69fc\") " pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-os-release\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-host\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342768 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afcd192c-f354-497f-a231-fe321f2f1311-cni-binary-copy\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b10be287-71ae-4d80-b703-35f0e3e25842-tmp\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-hostroot\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4632d1eb-0ae2-467d-9f9a-ff61dae76ec2-agent-certs\") pod \"konnectivity-agent-gtwrh\" (UID: \"4632d1eb-0ae2-467d-9f9a-ff61dae76ec2\") " pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:11:53.343674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342890 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-system-cni-dir\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342894 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7a8e5df-db0c-4345-84ab-bd237a9520f1-ovnkube-config\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5vls\" (UniqueName: \"kubernetes.io/projected/85a9d402-0dcc-4351-b661-124a897c69fc-kube-api-access-v5vls\") pod \"iptables-alerter-xzxgk\" (UID: \"85a9d402-0dcc-4351-b661-124a897c69fc\") " pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342939 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-var-lib-kubelet\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-cni-netd\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342945 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-var-lib-cni-multus\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.342996 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-etc-kubernetes\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343091 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afcd192c-f354-497f-a231-fe321f2f1311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343215 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal" event={"ID":"5c35be48bf00c794e91171a7db468cf0","Type":"ContainerStarted","Data":"f79b409c4fd2398d1bdcb85c014af3e46cdda3996325c46bdf4e2b2abb4b1974"} Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343290 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-hostroot\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343278 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-run-k8s-cni-cncf-io\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343407 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-os-release\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343356 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a9d402-0dcc-4351-b661-124a897c69fc-host-slash\") pod \"iptables-alerter-xzxgk\" (UID: \"85a9d402-0dcc-4351-b661-124a897c69fc\") " pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343331 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-registration-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343444 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/447beb12-e780-49da-bf7a-09ecc1ddb5ee-serviceca\") pod \"node-ca-wstkx\" (UID: \"447beb12-e780-49da-bf7a-09ecc1ddb5ee\") " pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343452 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-host\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343480 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-run-systemd\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343531 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85a9d402-0dcc-4351-b661-124a897c69fc-iptables-alerter-script\") pod \"iptables-alerter-xzxgk\" (UID: \"85a9d402-0dcc-4351-b661-124a897c69fc\") " pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.344517 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343548 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b19fff5-4887-4c03-b55e-d3ce73693c53-hosts-file\") pod \"node-resolver-b2n9c\" (UID: \"4b19fff5-4887-4c03-b55e-d3ce73693c53\") " pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343596 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-cni-netd\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343642 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343703 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343727 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-system-cni-dir\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-systemd-units\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343768 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-systemd-units\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-etc-openvswitch\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343853 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-run-ovn\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afcd192c-f354-497f-a231-fe321f2f1311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.343987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-var-lib-cni-bin\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-socket-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rkxx\" (UniqueName: \"kubernetes.io/projected/b278b201-14b9-4385-bd96-1217f541d675-kube-api-access-5rkxx\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-sysconfig\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.345368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8t7x\" (UniqueName: \"kubernetes.io/projected/447beb12-e780-49da-bf7a-09ecc1ddb5ee-kube-api-access-w8t7x\") pod \"node-ca-wstkx\" (UID: \"447beb12-e780-49da-bf7a-09ecc1ddb5ee\") " pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06a3e42b-393f-4d5e-9db9-b1f9003d7677-cni-binary-copy\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-var-lib-openvswitch\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-sys\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7a8e5df-db0c-4345-84ab-bd237a9520f1-ovnkube-script-lib\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344310 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-kubelet\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-sysctl-conf\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/447beb12-e780-49da-bf7a-09ecc1ddb5ee-host\") pod \"node-ca-wstkx\" (UID: \"447beb12-e780-49da-bf7a-09ecc1ddb5ee\") " pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344390 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-cni-dir\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344424 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-log-socket\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344451 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fxx\" (UniqueName: \"kubernetes.io/projected/06a3e42b-393f-4d5e-9db9-b1f9003d7677-kube-api-access-h2fxx\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-node-log\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-kubernetes\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-systemd\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-run-netns\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344625 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-daemon-config\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344633 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-run-netns\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.344737 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:11:53.346267 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.344809 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs podName:b278b201-14b9-4385-bd96-1217f541d675 nodeName:}" failed. No retries permitted until 2026-07-13 07:11:53.8447796 +0000 UTC m=+3.045556598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs") pod "network-metrics-daemon-k76c6" (UID: "b278b201-14b9-4385-bd96-1217f541d675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344853 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afcd192c-f354-497f-a231-fe321f2f1311-cnibin\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344892 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-run-ovn\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.344927 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.345104 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-host-kubelet\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.345584 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-sysconfig\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.345649 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-etc-openvswitch\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.345672 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-node-log\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.345713 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06a3e42b-393f-4d5e-9db9-b1f9003d7677-cni-binary-copy\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.345729 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-sys\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.345760 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-systemd\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.345770 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/447beb12-e780-49da-bf7a-09ecc1ddb5ee-host\") pod \"node-ca-wstkx\" (UID: \"447beb12-e780-49da-bf7a-09ecc1ddb5ee\") " pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.345833 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-run-openvswitch\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346040 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b19fff5-4887-4c03-b55e-d3ce73693c53-tmp-dir\") pod \"node-resolver-b2n9c\" (UID: \"4b19fff5-4887-4c03-b55e-d3ce73693c53\") " pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346116 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-var-lib-openvswitch\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346119 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7a8e5df-db0c-4345-84ab-bd237a9520f1-log-socket\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346175 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-kubernetes\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346177 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b10be287-71ae-4d80-b703-35f0e3e25842-etc-sysctl-conf\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.347547 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346203 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28eac7f2-067d-4aa0-a278-94e5e02246e7-socket-dir\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.348270 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346238 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-multus-cni-dir\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.348270 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346251 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-host-var-lib-cni-bin\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.348270 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7a8e5df-db0c-4345-84ab-bd237a9520f1-ovnkube-script-lib\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.348270 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346281 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06a3e42b-393f-4d5e-9db9-b1f9003d7677-cnibin\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.348270 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346828 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b10be287-71ae-4d80-b703-35f0e3e25842-tmp\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.348270 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.346853 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afcd192c-f354-497f-a231-fe321f2f1311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.348980 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.348961 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b10be287-71ae-4d80-b703-35f0e3e25842-etc-tuned\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.350001 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.349972 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7a8e5df-db0c-4345-84ab-bd237a9520f1-ovn-node-metrics-cert\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.352743 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.352712 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:11:53.352743 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.352740 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:11:53.352886 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.352753 2561 projected.go:196] Error preparing data for projected volume kube-api-access-wp8s8 for pod openshift-network-diagnostics/network-check-target-9vmrv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:11:53.352886 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.352830 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8 podName:d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe nodeName:}" failed. No retries permitted until 2026-07-13 07:11:53.852803028 +0000 UTC m=+3.053580028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8s8" (UniqueName: "kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8") pod "network-check-target-9vmrv" (UID: "d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:11:53.361681 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.361658 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfdnn\" (UniqueName: \"kubernetes.io/projected/4b19fff5-4887-4c03-b55e-d3ce73693c53-kube-api-access-wfdnn\") pod \"node-resolver-b2n9c\" (UID: \"4b19fff5-4887-4c03-b55e-d3ce73693c53\") " pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.365454 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.365153 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzt84\" (UniqueName: \"kubernetes.io/projected/afcd192c-f354-497f-a231-fe321f2f1311-kube-api-access-rzt84\") pod \"multus-additional-cni-plugins-ffpgp\" (UID: \"afcd192c-f354-497f-a231-fe321f2f1311\") " pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.365454 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.365404 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8t7x\" (UniqueName: \"kubernetes.io/projected/447beb12-e780-49da-bf7a-09ecc1ddb5ee-kube-api-access-w8t7x\") pod \"node-ca-wstkx\" (UID: \"447beb12-e780-49da-bf7a-09ecc1ddb5ee\") " pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.366796 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.366720 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d4vb\" (UniqueName: \"kubernetes.io/projected/28eac7f2-067d-4aa0-a278-94e5e02246e7-kube-api-access-8d4vb\") pod \"aws-ebs-csi-driver-node-6kpjv\" (UID: \"28eac7f2-067d-4aa0-a278-94e5e02246e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.367009 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.366990 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5vls\" (UniqueName: \"kubernetes.io/projected/85a9d402-0dcc-4351-b661-124a897c69fc-kube-api-access-v5vls\") pod \"iptables-alerter-xzxgk\" (UID: \"85a9d402-0dcc-4351-b661-124a897c69fc\") " pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.367580 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.367535 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rkxx\" (UniqueName: \"kubernetes.io/projected/b278b201-14b9-4385-bd96-1217f541d675-kube-api-access-5rkxx\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:53.367673 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.367615 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztkbw\" (UniqueName: \"kubernetes.io/projected/b10be287-71ae-4d80-b703-35f0e3e25842-kube-api-access-ztkbw\") pod \"tuned-tqkbl\" (UID: \"b10be287-71ae-4d80-b703-35f0e3e25842\") " pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.367923 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.367901 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znp9k\" (UniqueName: \"kubernetes.io/projected/e7a8e5df-db0c-4345-84ab-bd237a9520f1-kube-api-access-znp9k\") pod \"ovnkube-node-8424l\" (UID: \"e7a8e5df-db0c-4345-84ab-bd237a9520f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.369793 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.369770 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2fxx\" (UniqueName: \"kubernetes.io/projected/06a3e42b-393f-4d5e-9db9-b1f9003d7677-kube-api-access-h2fxx\") pod \"multus-zgz6c\" (UID: \"06a3e42b-393f-4d5e-9db9-b1f9003d7677\") " pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.445535 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.445495 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-kubelet-config\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:53.445721 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.445552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:53.445721 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.445582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4632d1eb-0ae2-467d-9f9a-ff61dae76ec2-konnectivity-ca\") pod \"konnectivity-agent-gtwrh\" (UID: \"4632d1eb-0ae2-467d-9f9a-ff61dae76ec2\") " pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:11:53.445721 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.445599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-dbus\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:53.445721 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.445620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4632d1eb-0ae2-467d-9f9a-ff61dae76ec2-agent-certs\") pod \"konnectivity-agent-gtwrh\" (UID: \"4632d1eb-0ae2-467d-9f9a-ff61dae76ec2\") " pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:11:53.445721 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.445647 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-kubelet-config\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:53.445993 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.445753 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:11:53.445993 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.445826 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-dbus\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:53.445993 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.445847 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret podName:f25f49d9-494c-4db9-a4ab-4dc4b84dab74 nodeName:}" failed. No retries permitted until 2026-07-13 07:11:53.945815446 +0000 UTC m=+3.146592445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret") pod "global-pull-secret-syncer-9qtcc" (UID: "f25f49d9-494c-4db9-a4ab-4dc4b84dab74") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:11:53.446593 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.446490 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4632d1eb-0ae2-467d-9f9a-ff61dae76ec2-konnectivity-ca\") pod \"konnectivity-agent-gtwrh\" (UID: \"4632d1eb-0ae2-467d-9f9a-ff61dae76ec2\") " pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:11:53.448892 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.448836 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4632d1eb-0ae2-467d-9f9a-ff61dae76ec2-agent-certs\") pod \"konnectivity-agent-gtwrh\" (UID: \"4632d1eb-0ae2-467d-9f9a-ff61dae76ec2\") " pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:11:53.528876 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.528842 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2n9c" Jul 13 07:11:53.538734 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.538705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:11:53.550127 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.550097 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" Jul 13 07:11:53.557977 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.557945 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zgz6c" Jul 13 07:11:53.566637 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.566613 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" Jul 13 07:11:53.573389 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.573368 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" Jul 13 07:11:53.584144 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.584117 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzxgk" Jul 13 07:11:53.597023 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.596984 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wstkx" Jul 13 07:11:53.605555 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.605529 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:11:53.848476 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.848436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:53.848643 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.848609 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:11:53.848704 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.848690 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs podName:b278b201-14b9-4385-bd96-1217f541d675 nodeName:}" failed. No retries permitted until 2026-07-13 07:11:54.848668045 +0000 UTC m=+4.049445052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs") pod "network-metrics-daemon-k76c6" (UID: "b278b201-14b9-4385-bd96-1217f541d675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:11:53.949851 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.949807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8s8\" (UniqueName: \"kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8\") pod \"network-check-target-9vmrv\" (UID: \"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe\") " pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:11:53.950011 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:53.949862 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:53.950011 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.949984 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:11:53.950011 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.950005 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:11:53.950011 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.950008 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:11:53.950170 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.950016 2561 projected.go:196] Error preparing data for projected volume kube-api-access-wp8s8 for pod openshift-network-diagnostics/network-check-target-9vmrv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:11:53.950170 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.950082 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8 podName:d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe nodeName:}" failed. No retries permitted until 2026-07-13 07:11:54.950052756 +0000 UTC m=+4.150829756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8s8" (UniqueName: "kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8") pod "network-check-target-9vmrv" (UID: "d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:11:53.950170 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:53.950095 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret podName:f25f49d9-494c-4db9-a4ab-4dc4b84dab74 nodeName:}" failed. No retries permitted until 2026-07-13 07:11:54.950089312 +0000 UTC m=+4.150866307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret") pod "global-pull-secret-syncer-9qtcc" (UID: "f25f49d9-494c-4db9-a4ab-4dc4b84dab74") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:11:54.323899 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:54.323852 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 07:06:53 +0000 UTC" deadline="2028-04-29 09:10:03.55792493 +0000 UTC" Jul 13 07:11:54.323899 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:54.323892 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15745h58m9.234038492s" Jul 13 07:11:54.434754 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:54.434723 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a9d402_0dcc_4351_b661_124a897c69fc.slice/crio-1f3db990e17456e6e788a9224596e6defbb262cc9d5578b91bdaa47efd55222c WatchSource:0}: Error finding container 1f3db990e17456e6e788a9224596e6defbb262cc9d5578b91bdaa47efd55222c: Status 404 returned error can't find the container with id 1f3db990e17456e6e788a9224596e6defbb262cc9d5578b91bdaa47efd55222c Jul 13 07:11:54.436907 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:54.436878 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b19fff5_4887_4c03_b55e_d3ce73693c53.slice/crio-5af25262174b80f16d46d2518dcd729987626e2d70fb8a6de09a57e4fb349a93 WatchSource:0}: Error finding container 5af25262174b80f16d46d2518dcd729987626e2d70fb8a6de09a57e4fb349a93: Status 404 returned error can't find the container with id 5af25262174b80f16d46d2518dcd729987626e2d70fb8a6de09a57e4fb349a93 Jul 13 07:11:54.439230 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:54.439155 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10be287_71ae_4d80_b703_35f0e3e25842.slice/crio-3e48d15edd70e34eae6c6f37db243110d6ee8f37aca21bc93fad68c6ca3a86f0 WatchSource:0}: Error finding container 3e48d15edd70e34eae6c6f37db243110d6ee8f37aca21bc93fad68c6ca3a86f0: Status 404 returned error can't find the container with id 3e48d15edd70e34eae6c6f37db243110d6ee8f37aca21bc93fad68c6ca3a86f0 Jul 13 07:11:54.441531 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:54.441507 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a3e42b_393f_4d5e_9db9_b1f9003d7677.slice/crio-60132a990398abb9aeffc271efe1e083f9fbf67b56328d0e05b4ad196594ff83 WatchSource:0}: Error finding container 60132a990398abb9aeffc271efe1e083f9fbf67b56328d0e05b4ad196594ff83: Status 404 returned error can't find the container with id 60132a990398abb9aeffc271efe1e083f9fbf67b56328d0e05b4ad196594ff83 Jul 13 07:11:54.442371 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:11:54.442351 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447beb12_e780_49da_bf7a_09ecc1ddb5ee.slice/crio-a175706be5213ddbd2832a938ed52f76512069a9f33f0a781152ff6387791ab0 WatchSource:0}: Error finding container a175706be5213ddbd2832a938ed52f76512069a9f33f0a781152ff6387791ab0: Status 404 returned error can't find the container with id a175706be5213ddbd2832a938ed52f76512069a9f33f0a781152ff6387791ab0 Jul 13 07:11:54.858072 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:54.857872 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:54.858231 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:54.858036 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:11:54.858231 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:54.858167 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs podName:b278b201-14b9-4385-bd96-1217f541d675 nodeName:}" failed. No retries permitted until 2026-07-13 07:11:56.858150932 +0000 UTC m=+6.058927927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs") pod "network-metrics-daemon-k76c6" (UID: "b278b201-14b9-4385-bd96-1217f541d675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:11:54.958964 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:54.958873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8s8\" (UniqueName: \"kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8\") pod \"network-check-target-9vmrv\" (UID: \"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe\") " pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:11:54.959128 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:54.958948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:54.959128 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:54.959007 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:11:54.959128 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:54.959032 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:11:54.959128 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:54.959044 2561 projected.go:196] Error preparing data for projected volume kube-api-access-wp8s8 for pod openshift-network-diagnostics/network-check-target-9vmrv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:11:54.959128 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:54.959096 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:11:54.959128 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:54.959127 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8 podName:d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe nodeName:}" failed. No retries permitted until 2026-07-13 07:11:56.959106562 +0000 UTC m=+6.159883576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8s8" (UniqueName: "kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8") pod "network-check-target-9vmrv" (UID: "d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:11:54.959365 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:54.959153 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret podName:f25f49d9-494c-4db9-a4ab-4dc4b84dab74 nodeName:}" failed. No retries permitted until 2026-07-13 07:11:56.959137202 +0000 UTC m=+6.159914200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret") pod "global-pull-secret-syncer-9qtcc" (UID: "f25f49d9-494c-4db9-a4ab-4dc4b84dab74") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:11:55.325180 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.325046 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 07:06:53 +0000 UTC" deadline="2028-03-09 01:57:46.83133919 +0000 UTC" Jul 13 07:11:55.325180 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.325127 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14514h45m51.506216175s" Jul 13 07:11:55.337570 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.335363 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:55.337570 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:55.335517 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:11:55.337570 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.336019 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:55.337570 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:55.336157 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:11:55.337570 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.336201 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:11:55.337570 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:55.336269 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:11:55.371466 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.371426 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzxgk" event={"ID":"85a9d402-0dcc-4351-b661-124a897c69fc","Type":"ContainerStarted","Data":"1f3db990e17456e6e788a9224596e6defbb262cc9d5578b91bdaa47efd55222c"} Jul 13 07:11:55.374747 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.374030 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal" event={"ID":"5c35be48bf00c794e91171a7db468cf0","Type":"ContainerStarted","Data":"554ba73e0326d38b3f57014327dc75872cdbc6058719214b746dba7044f718c1"} Jul 13 07:11:55.380777 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.380738 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" event={"ID":"afcd192c-f354-497f-a231-fe321f2f1311","Type":"ContainerStarted","Data":"812ee4e542dcfc4f3f74bb209daa6ecab2d6843bf59efd946aa8a867174d1962"} Jul 13 07:11:55.403302 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.403258 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" event={"ID":"28eac7f2-067d-4aa0-a278-94e5e02246e7","Type":"ContainerStarted","Data":"78d53b54f93ff05a79eabcd2159538dda2b979a6a4a20c6e4821002b6040a966"} Jul 13 07:11:55.415016 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.414979 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gtwrh" event={"ID":"4632d1eb-0ae2-467d-9f9a-ff61dae76ec2","Type":"ContainerStarted","Data":"953ec8d553082cc94d8d413df689d261d57fcc56a098d8de941d70c637818e77"} Jul 13 07:11:55.440134 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.440095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zgz6c" event={"ID":"06a3e42b-393f-4d5e-9db9-b1f9003d7677","Type":"ContainerStarted","Data":"60132a990398abb9aeffc271efe1e083f9fbf67b56328d0e05b4ad196594ff83"} Jul 13 07:11:55.461901 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.461859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" event={"ID":"b10be287-71ae-4d80-b703-35f0e3e25842","Type":"ContainerStarted","Data":"3e48d15edd70e34eae6c6f37db243110d6ee8f37aca21bc93fad68c6ca3a86f0"} Jul 13 07:11:55.480974 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.480813 2561 generic.go:356] "Generic (PLEG): container finished" podID="ac45b616305bb080e150a9e0a1c57b35" containerID="61c8c55bb21058ca2d39fcf2e3d193d04d79eb1aa33b14ed01a248861a3def5d" exitCode=0 Jul 13 07:11:55.481231 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.481157 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" event={"ID":"ac45b616305bb080e150a9e0a1c57b35","Type":"ContainerDied","Data":"61c8c55bb21058ca2d39fcf2e3d193d04d79eb1aa33b14ed01a248861a3def5d"} Jul 13 07:11:55.499847 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.499797 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-188.ec2.internal" podStartSLOduration=3.499776342 podStartE2EDuration="3.499776342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:11:55.395883578 +0000 UTC m=+4.596660596" watchObservedRunningTime="2026-07-13 07:11:55.499776342 +0000 UTC m=+4.700553362" Jul 13 07:11:55.501881 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.501854 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" event={"ID":"e7a8e5df-db0c-4345-84ab-bd237a9520f1","Type":"ContainerStarted","Data":"084c6d304d5b17fa9f4f064a8a0450254d8c33c090a69e236d77281e931dfa22"} Jul 13 07:11:55.504390 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.504362 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wstkx" event={"ID":"447beb12-e780-49da-bf7a-09ecc1ddb5ee","Type":"ContainerStarted","Data":"a175706be5213ddbd2832a938ed52f76512069a9f33f0a781152ff6387791ab0"} Jul 13 07:11:55.520516 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:55.520479 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2n9c" event={"ID":"4b19fff5-4887-4c03-b55e-d3ce73693c53","Type":"ContainerStarted","Data":"5af25262174b80f16d46d2518dcd729987626e2d70fb8a6de09a57e4fb349a93"} Jul 13 07:11:56.537660 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:56.537625 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" event={"ID":"ac45b616305bb080e150a9e0a1c57b35","Type":"ContainerStarted","Data":"0542654b3be1e0fc12ff9cec8ce069f2a7600a8a2d6da95de265f8f9fb95b944"} Jul 13 07:11:56.872743 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:56.872642 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:56.872900 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:56.872876 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:11:56.872974 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:56.872949 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs podName:b278b201-14b9-4385-bd96-1217f541d675 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:00.872929164 +0000 UTC m=+10.073706178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs") pod "network-metrics-daemon-k76c6" (UID: "b278b201-14b9-4385-bd96-1217f541d675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:11:56.974278 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:56.973431 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8s8\" (UniqueName: \"kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8\") pod \"network-check-target-9vmrv\" (UID: \"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe\") " pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:11:56.974278 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:56.973504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:56.974278 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:56.973661 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:11:56.974278 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:56.973723 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret podName:f25f49d9-494c-4db9-a4ab-4dc4b84dab74 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:00.973705153 +0000 UTC m=+10.174482154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret") pod "global-pull-secret-syncer-9qtcc" (UID: "f25f49d9-494c-4db9-a4ab-4dc4b84dab74") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:11:56.974278 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:56.974144 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:11:56.974278 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:56.974162 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:11:56.974278 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:56.974175 2561 projected.go:196] Error preparing data for projected volume kube-api-access-wp8s8 for pod openshift-network-diagnostics/network-check-target-9vmrv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:11:56.974278 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:56.974223 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8 podName:d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe nodeName:}" failed. No retries permitted until 2026-07-13 07:12:00.974208624 +0000 UTC m=+10.174985626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8s8" (UniqueName: "kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8") pod "network-check-target-9vmrv" (UID: "d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:11:57.336262 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:57.336229 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:57.336465 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:57.336267 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:57.336465 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:57.336229 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:11:57.336465 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:57.336381 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:11:57.336621 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:57.336471 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:11:57.336621 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:57.336572 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:11:59.335891 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:59.335424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:11:59.335891 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:59.335450 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:11:59.335891 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:59.335573 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:11:59.335891 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:11:59.335632 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:11:59.335891 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:59.335711 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:11:59.335891 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:11:59.335801 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:00.908555 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:00.908507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:00.909001 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:00.908707 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:00.909001 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:00.908778 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs podName:b278b201-14b9-4385-bd96-1217f541d675 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:08.908757264 +0000 UTC m=+18.109534259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs") pod "network-metrics-daemon-k76c6" (UID: "b278b201-14b9-4385-bd96-1217f541d675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:01.009915 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:01.009347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8s8\" (UniqueName: \"kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8\") pod \"network-check-target-9vmrv\" (UID: \"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe\") " pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:01.009915 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:01.009414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:01.009915 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:01.009549 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:01.009915 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:01.009557 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:12:01.009915 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:01.009586 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:12:01.009915 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:01.009602 2561 projected.go:196] Error preparing data for projected volume kube-api-access-wp8s8 for pod openshift-network-diagnostics/network-check-target-9vmrv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:01.009915 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:01.009604 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret podName:f25f49d9-494c-4db9-a4ab-4dc4b84dab74 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:09.009586446 +0000 UTC m=+18.210363441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret") pod "global-pull-secret-syncer-9qtcc" (UID: "f25f49d9-494c-4db9-a4ab-4dc4b84dab74") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:01.009915 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:01.009659 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8 podName:d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe nodeName:}" failed. No retries permitted until 2026-07-13 07:12:09.009642355 +0000 UTC m=+18.210419352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8s8" (UniqueName: "kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8") pod "network-check-target-9vmrv" (UID: "d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:01.335876 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:01.335843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:01.336044 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:01.335941 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:01.336185 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:01.336166 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:01.336304 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:01.336285 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:01.336363 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:01.336345 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:01.336450 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:01.336432 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:03.343309 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:03.343175 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:03.343309 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:03.343207 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:03.343309 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:03.343232 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:03.343933 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:03.343594 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:03.343933 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:03.343685 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:03.343933 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:03.343798 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:05.339098 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:05.339051 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:05.339545 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:05.339074 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:05.339545 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:05.339183 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:05.339545 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:05.339073 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:05.339545 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:05.339306 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:05.339545 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:05.339394 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:07.335203 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:07.335164 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:07.335203 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:07.335188 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:07.335718 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:07.335176 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:07.335718 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:07.335304 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:07.335718 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:07.335419 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:07.335718 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:07.335510 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:08.976899 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:08.976861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:08.977374 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:08.977013 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:08.977374 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:08.977095 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs podName:b278b201-14b9-4385-bd96-1217f541d675 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:24.977075329 +0000 UTC m=+34.177852341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs") pod "network-metrics-daemon-k76c6" (UID: "b278b201-14b9-4385-bd96-1217f541d675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:09.078130 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:09.078090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8s8\" (UniqueName: \"kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8\") pod \"network-check-target-9vmrv\" (UID: \"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe\") " pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:09.078330 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:09.078142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:09.078330 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:09.078234 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:09.078330 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:09.078247 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:12:09.078330 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:09.078266 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:12:09.078330 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:09.078276 2561 projected.go:196] Error preparing data for projected volume kube-api-access-wp8s8 for pod openshift-network-diagnostics/network-check-target-9vmrv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:09.078330 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:09.078298 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret podName:f25f49d9-494c-4db9-a4ab-4dc4b84dab74 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:25.078280445 +0000 UTC m=+34.279057444 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret") pod "global-pull-secret-syncer-9qtcc" (UID: "f25f49d9-494c-4db9-a4ab-4dc4b84dab74") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:09.078330 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:09.078319 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8 podName:d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe nodeName:}" failed. No retries permitted until 2026-07-13 07:12:25.078304621 +0000 UTC m=+34.279081615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8s8" (UniqueName: "kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8") pod "network-check-target-9vmrv" (UID: "d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:09.335215 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:09.335124 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:09.335391 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:09.335135 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:09.335391 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:09.335230 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:09.335391 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:09.335135 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:09.335391 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:09.335318 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:09.335621 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:09.335404 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:11.335848 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:11.335810 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:11.336354 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:11.335899 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:11.336354 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:11.336278 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:11.336472 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:11.336357 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:11.336472 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:11.336394 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:11.336472 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:11.336461 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:13.335636 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:13.335593 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:13.335636 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:13.335636 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:13.336228 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:13.335601 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:13.336228 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:13.335740 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:13.336228 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:13.335833 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:13.336228 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:13.335917 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:14.580619 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.580224 2561 generic.go:356] "Generic (PLEG): container finished" podID="afcd192c-f354-497f-a231-fe321f2f1311" containerID="4283c063a2e56deafe21aa73e5873ef8449c2b73ce8351bd5e58926d63c80aee" exitCode=0 Jul 13 07:12:14.581424 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.580451 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" event={"ID":"afcd192c-f354-497f-a231-fe321f2f1311","Type":"ContainerDied","Data":"4283c063a2e56deafe21aa73e5873ef8449c2b73ce8351bd5e58926d63c80aee"} Jul 13 07:12:14.582946 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.582893 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" event={"ID":"28eac7f2-067d-4aa0-a278-94e5e02246e7","Type":"ContainerStarted","Data":"129e7af03c7f404e6eff95939af160f7f1108008acd60d39c240cdaa71c640d7"} Jul 13 07:12:14.586806 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.586774 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gtwrh" event={"ID":"4632d1eb-0ae2-467d-9f9a-ff61dae76ec2","Type":"ContainerStarted","Data":"aada6ec7ee05364d747c12c08161cf3a815079c46e6e99ef64e280e2ffd0fd9b"} Jul 13 07:12:14.589212 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.589184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zgz6c" event={"ID":"06a3e42b-393f-4d5e-9db9-b1f9003d7677","Type":"ContainerStarted","Data":"6043dc25e61d71a0705b5deaba572ce4889af46ccfc37fbe6614bb72e594cc2e"} Jul 13 07:12:14.590987 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.590961 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" event={"ID":"b10be287-71ae-4d80-b703-35f0e3e25842","Type":"ContainerStarted","Data":"c6729ce0155a52381e878f3a94aaf5b1ed8742f3bc6129316ac687627fb0f97c"} Jul 13 07:12:14.594384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.594360 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:12:14.594734 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.594709 2561 generic.go:356] "Generic (PLEG): container finished" podID="e7a8e5df-db0c-4345-84ab-bd237a9520f1" containerID="2b6aad8f12696f6d14df61a88fe63da42497b4d29d1f04fd9fab974f1c8939e2" exitCode=1 Jul 13 07:12:14.594844 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.594781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" event={"ID":"e7a8e5df-db0c-4345-84ab-bd237a9520f1","Type":"ContainerStarted","Data":"16501dfc6854b53995d846f344cc97a7dbd80ec4388e12f80cb1b527ffddbdda"} Jul 13 07:12:14.594905 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.594849 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" event={"ID":"e7a8e5df-db0c-4345-84ab-bd237a9520f1","Type":"ContainerStarted","Data":"800e4d4475c5d787be630ea29105821bd563ff6af3a2aafbcb35920a5aefa0d1"} Jul 13 07:12:14.594905 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.594892 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" event={"ID":"e7a8e5df-db0c-4345-84ab-bd237a9520f1","Type":"ContainerStarted","Data":"271c9dfa5360415dee32bbc67a37f5e5d2a28e65674180d38a68952dceb8d8af"} Jul 13 07:12:14.595010 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.594921 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" event={"ID":"e7a8e5df-db0c-4345-84ab-bd237a9520f1","Type":"ContainerStarted","Data":"6c65543d039f9cd8120b8e85b672b27b2ed3a57472a9c34243bf77d4ce63dd17"} Jul 13 07:12:14.595010 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.594949 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" event={"ID":"e7a8e5df-db0c-4345-84ab-bd237a9520f1","Type":"ContainerDied","Data":"2b6aad8f12696f6d14df61a88fe63da42497b4d29d1f04fd9fab974f1c8939e2"} Jul 13 07:12:14.595010 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.594986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" event={"ID":"e7a8e5df-db0c-4345-84ab-bd237a9520f1","Type":"ContainerStarted","Data":"cfd86277dc237c29abd8b98df6caaebefedab5687735a9335151c9b92980092d"} Jul 13 07:12:14.596474 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.596448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wstkx" event={"ID":"447beb12-e780-49da-bf7a-09ecc1ddb5ee","Type":"ContainerStarted","Data":"b132b17af35c1a47b9eeb250f85e41c821acbf867ab72f42fa75933926918908"} Jul 13 07:12:14.597837 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.597789 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2n9c" event={"ID":"4b19fff5-4887-4c03-b55e-d3ce73693c53","Type":"ContainerStarted","Data":"99052f3e93e253ea0be84048930f2ab06dbe1ec8beec03c1a56e0605742454f8"} Jul 13 07:12:14.604526 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.604469 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-188.ec2.internal" podStartSLOduration=22.604456994 podStartE2EDuration="22.604456994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:11:56.558213623 +0000 UTC m=+5.758990641" watchObservedRunningTime="2026-07-13 07:12:14.604456994 +0000 UTC m=+23.805234010" Jul 13 07:12:14.620722 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.620655 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b2n9c" podStartSLOduration=4.376897855 podStartE2EDuration="23.62063424s" totalImagesPullingTime="19.243736385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:14.620235537 +0000 UTC m=+23.821012553" watchObservedRunningTime="2026-07-13 07:12:14.62063424 +0000 UTC m=+23.821411258" Jul 13 07:12:14.668844 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.668781 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tqkbl" podStartSLOduration=4.418840628 podStartE2EDuration="23.668757421s" totalImagesPullingTime="19.249916793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:14.643675406 +0000 UTC m=+23.844452424" watchObservedRunningTime="2026-07-13 07:12:14.668757421 +0000 UTC m=+23.869534456" Jul 13 07:12:14.700383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.700273 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gtwrh" podStartSLOduration=7.762199543 podStartE2EDuration="22.700251359s" totalImagesPullingTime="14.938051816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:14.700236832 +0000 UTC m=+23.901013851" watchObservedRunningTime="2026-07-13 07:12:14.700251359 +0000 UTC m=+23.901028378" Jul 13 07:12:14.700542 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.700471 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wstkx" podStartSLOduration=3.463172646 podStartE2EDuration="22.700462888s" totalImagesPullingTime="19.237290242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:14.668375519 +0000 UTC m=+23.869152561" watchObservedRunningTime="2026-07-13 07:12:14.700462888 +0000 UTC m=+23.901239914" Jul 13 07:12:14.753489 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:14.753434 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zgz6c" podStartSLOduration=4.452260983 podStartE2EDuration="23.753416204s" totalImagesPullingTime="19.301155221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:14.753260904 +0000 UTC m=+23.954037921" watchObservedRunningTime="2026-07-13 07:12:14.753416204 +0000 UTC m=+23.954193220" Jul 13 07:12:15.335640 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:15.335606 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:15.335640 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:15.335630 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:15.335864 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:15.335609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:15.335864 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:15.335763 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:15.335864 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:15.335821 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:15.336022 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:15.335914 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:15.476038 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:15.476002 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 07:12:15.602689 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:15.602592 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzxgk" event={"ID":"85a9d402-0dcc-4351-b661-124a897c69fc","Type":"ContainerStarted","Data":"bc36b34f34e65d41c0e8a01e45dd51ee5399d18177da0715b67e7ec90d9eaa21"} Jul 13 07:12:15.604756 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:15.604729 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" event={"ID":"28eac7f2-067d-4aa0-a278-94e5e02246e7","Type":"ContainerStarted","Data":"8281b09fbd4013e8478266f4c53c00c79a1341515b15d7937f0b0f75dba32408"} Jul 13 07:12:16.298670 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:16.298567 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T07:12:15.47603321Z","UUID":"43de7c37-ffca-45f1-ad4a-ce3342521812","Handler":null,"Name":"","Endpoint":""} Jul 13 07:12:16.300258 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:16.300226 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 07:12:16.300408 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:16.300269 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 07:12:17.335418 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.335231 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:17.335943 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.335231 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:17.335943 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:17.335520 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:17.335943 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.335231 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:17.335943 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:17.335592 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:17.335943 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:17.335667 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:17.605909 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.605820 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:12:17.606557 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.606535 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:12:17.613005 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.612956 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" event={"ID":"28eac7f2-067d-4aa0-a278-94e5e02246e7","Type":"ContainerStarted","Data":"d8caa5defbacd70e5f4b507c58c5da250d6c7637174a6f638d98ed12bcde5be0"} Jul 13 07:12:17.617843 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.617817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:12:17.618357 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.618330 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" event={"ID":"e7a8e5df-db0c-4345-84ab-bd237a9520f1","Type":"ContainerStarted","Data":"6bc4e22503c2487cd09dc176b9a846cbcdad4a21c98bce5bbdd2d37004679bbe"} Jul 13 07:12:17.618522 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.618506 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:12:17.619073 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.619038 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gtwrh" Jul 13 07:12:17.624032 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.623986 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzxgk" podStartSLOduration=7.357746597 podStartE2EDuration="26.623967495s" totalImagesPullingTime="19.266220898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:15.631509888 +0000 UTC m=+24.832286906" watchObservedRunningTime="2026-07-13 07:12:17.623967495 +0000 UTC m=+26.824744512" Jul 13 07:12:17.666715 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:17.666651 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpjv" podStartSLOduration=4.618028717 podStartE2EDuration="26.666629877s" totalImagesPullingTime="22.04860116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:17.666272508 +0000 UTC m=+26.867049580" watchObservedRunningTime="2026-07-13 07:12:17.666629877 +0000 UTC m=+26.867406896" Jul 13 07:12:19.335428 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:19.335378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:19.336145 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:19.335378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:19.336145 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:19.335528 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:19.336145 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:19.335596 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:19.336145 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:19.335718 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:19.336145 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:19.335793 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:20.627460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:20.627253 2561 generic.go:356] "Generic (PLEG): container finished" podID="afcd192c-f354-497f-a231-fe321f2f1311" containerID="e24affbe3c53d929e74b6d559bf23d9c32560fdc1a6de4b1e81a7e1a9e6ce264" exitCode=0 Jul 13 07:12:20.628178 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:20.627342 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" event={"ID":"afcd192c-f354-497f-a231-fe321f2f1311","Type":"ContainerDied","Data":"e24affbe3c53d929e74b6d559bf23d9c32560fdc1a6de4b1e81a7e1a9e6ce264"} Jul 13 07:12:20.631199 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:20.631179 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:12:20.631561 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:20.631533 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" event={"ID":"e7a8e5df-db0c-4345-84ab-bd237a9520f1","Type":"ContainerStarted","Data":"b600551da3b51b2b5370165b2182caa71ca5caa0edb0159b16c426c2c8b2222d"} Jul 13 07:12:20.631784 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:20.631767 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:12:20.631856 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:20.631838 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:12:20.631908 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:20.631889 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:12:20.632040 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:20.632024 2561 scope.go:117] "RemoveContainer" containerID="2b6aad8f12696f6d14df61a88fe63da42497b4d29d1f04fd9fab974f1c8939e2" Jul 13 07:12:20.650970 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:20.650941 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:12:20.651200 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:20.651184 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:12:21.336940 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:21.336896 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:21.337200 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:21.337013 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:21.337200 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:21.337085 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:21.337200 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:21.337079 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:21.337200 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:21.337182 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:21.337373 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:21.337265 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:21.638115 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:21.638031 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:12:21.638576 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:21.638498 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" event={"ID":"e7a8e5df-db0c-4345-84ab-bd237a9520f1","Type":"ContainerStarted","Data":"f047a6d5e4c1c4b9013732ac18ff2eebddcaef2caf47f63caed79bf2c8a5cc2c"} Jul 13 07:12:21.670318 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:21.670270 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" podStartSLOduration=11.327231008 podStartE2EDuration="30.670253611s" totalImagesPullingTime="19.343022603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:21.669656626 +0000 UTC m=+30.870433643" watchObservedRunningTime="2026-07-13 07:12:21.670253611 +0000 UTC m=+30.871030628" Jul 13 07:12:22.148680 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:22.148474 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9qtcc"] Jul 13 07:12:22.148897 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:22.148752 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:22.148897 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:22.148847 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:22.152345 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:22.152304 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9vmrv"] Jul 13 07:12:22.152476 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:22.152414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:22.152731 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:22.152513 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:22.153381 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:22.153352 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k76c6"] Jul 13 07:12:22.153504 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:22.153465 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:22.153591 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:22.153571 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:22.642626 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:22.642584 2561 generic.go:356] "Generic (PLEG): container finished" podID="afcd192c-f354-497f-a231-fe321f2f1311" containerID="18dcadfdb69dc456e37df989ac5fde95efe11bc4a06c17e133e74614028eccd9" exitCode=0 Jul 13 07:12:22.643087 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:22.642708 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" event={"ID":"afcd192c-f354-497f-a231-fe321f2f1311","Type":"ContainerDied","Data":"18dcadfdb69dc456e37df989ac5fde95efe11bc4a06c17e133e74614028eccd9"} Jul 13 07:12:23.335365 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:23.335331 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:23.335562 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:23.335438 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:24.335662 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:24.335567 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:24.336392 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:24.335710 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:24.336392 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:24.335755 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:24.336392 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:24.335861 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:24.649677 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:24.649591 2561 generic.go:356] "Generic (PLEG): container finished" podID="afcd192c-f354-497f-a231-fe321f2f1311" containerID="72e0dcf1202feaf2ee7295bbc62eb26f8ac0b232b8627e862bb174b75253d02b" exitCode=0 Jul 13 07:12:24.649677 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:24.649654 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" event={"ID":"afcd192c-f354-497f-a231-fe321f2f1311","Type":"ContainerDied","Data":"72e0dcf1202feaf2ee7295bbc62eb26f8ac0b232b8627e862bb174b75253d02b"} Jul 13 07:12:24.994387 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:24.994355 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:24.994545 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:24.994508 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:24.994584 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:24.994577 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs podName:b278b201-14b9-4385-bd96-1217f541d675 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:56.994561811 +0000 UTC m=+66.195338809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs") pod "network-metrics-daemon-k76c6" (UID: "b278b201-14b9-4385-bd96-1217f541d675") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:25.095188 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:25.095147 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8s8\" (UniqueName: \"kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8\") pod \"network-check-target-9vmrv\" (UID: \"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe\") " pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:25.095515 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:25.095216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:25.095515 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:25.095326 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:12:25.095515 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:25.095356 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:12:25.095515 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:25.095358 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:25.095515 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:25.095372 2561 projected.go:196] Error preparing data for projected volume kube-api-access-wp8s8 for pod openshift-network-diagnostics/network-check-target-9vmrv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:25.095515 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:25.095423 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8 podName:d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe nodeName:}" failed. No retries permitted until 2026-07-13 07:12:57.095409106 +0000 UTC m=+66.296186100 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wp8s8" (UniqueName: "kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8") pod "network-check-target-9vmrv" (UID: "d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:25.095515 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:25.095442 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret podName:f25f49d9-494c-4db9-a4ab-4dc4b84dab74 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:57.095432573 +0000 UTC m=+66.296209567 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret") pod "global-pull-secret-syncer-9qtcc" (UID: "f25f49d9-494c-4db9-a4ab-4dc4b84dab74") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:25.335861 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:25.335772 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:25.336267 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:25.335885 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vmrv" podUID="d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe" Jul 13 07:12:26.335045 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.335004 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:26.335251 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.335049 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:26.335316 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:26.335272 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtcc" podUID="f25f49d9-494c-4db9-a4ab-4dc4b84dab74" Jul 13 07:12:26.335434 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:26.335409 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k76c6" podUID="b278b201-14b9-4385-bd96-1217f541d675" Jul 13 07:12:26.577098 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.577049 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-188.ec2.internal" event="NodeReady" Jul 13 07:12:26.577533 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.577227 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 07:12:26.611802 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.611660 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54fcc6ff69-krck2"] Jul 13 07:12:26.613438 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.613417 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.615801 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.615766 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 07:12:26.615950 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.615811 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 07:12:26.616023 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.615949 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 07:12:26.616231 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.616214 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b6hvc\"" Jul 13 07:12:26.621354 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.621327 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 07:12:26.626677 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.626647 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54fcc6ff69-krck2"] Jul 13 07:12:26.628654 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.628625 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-76h2t"] Jul 13 07:12:26.632173 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.632145 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2htcq"] Jul 13 07:12:26.632318 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.632299 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.634190 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.634166 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2htcq" Jul 13 07:12:26.634820 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.634794 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 07:12:26.634931 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.634827 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj5f5\"" Jul 13 07:12:26.634931 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.634882 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 07:12:26.636722 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.636487 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 07:12:26.636722 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.636492 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x4nqx\"" Jul 13 07:12:26.636722 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.636548 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 07:12:26.636990 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.636894 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 07:12:26.639484 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.639460 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2htcq"] Jul 13 07:12:26.643740 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.643713 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-76h2t"] Jul 13 07:12:26.709149 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxvw4\" (UniqueName: \"kubernetes.io/projected/52117e3a-733a-4799-939e-c8eeaa7f2c0d-kube-api-access-qxvw4\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.709149 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-bound-sa-token\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.709400 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709240 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.709400 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-certificates\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.709400 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52117e3a-733a-4799-939e-c8eeaa7f2c0d-tmp-dir\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.709400 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-image-registry-private-configuration\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.709566 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52117e3a-733a-4799-939e-c8eeaa7f2c0d-config-volume\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.709566 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-installation-pull-secrets\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.709566 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9db3791-7a75-4fe4-9948-311b6be55d1b-cert\") pod \"ingress-canary-2htcq\" (UID: \"e9db3791-7a75-4fe4-9948-311b6be55d1b\") " pod="openshift-ingress-canary/ingress-canary-2htcq" Jul 13 07:12:26.709566 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709549 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67gz5\" (UniqueName: \"kubernetes.io/projected/e9db3791-7a75-4fe4-9948-311b6be55d1b-kube-api-access-67gz5\") pod \"ingress-canary-2htcq\" (UID: \"e9db3791-7a75-4fe4-9948-311b6be55d1b\") " pod="openshift-ingress-canary/ingress-canary-2htcq" Jul 13 07:12:26.709713 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.709713 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-trusted-ca\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.709713 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6297f159-24b8-47e2-ba47-3a43876f9abf-ca-trust-extracted\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.709713 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.709696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46z6q\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-kube-api-access-46z6q\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.763211 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.763160 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwrh_4632d1eb-0ae2-467d-9f9a-ff61dae76ec2/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:26.811119 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-installation-pull-secrets\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.811304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9db3791-7a75-4fe4-9948-311b6be55d1b-cert\") pod \"ingress-canary-2htcq\" (UID: \"e9db3791-7a75-4fe4-9948-311b6be55d1b\") " pod="openshift-ingress-canary/ingress-canary-2htcq" Jul 13 07:12:26.811304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67gz5\" (UniqueName: \"kubernetes.io/projected/e9db3791-7a75-4fe4-9948-311b6be55d1b-kube-api-access-67gz5\") pod \"ingress-canary-2htcq\" (UID: \"e9db3791-7a75-4fe4-9948-311b6be55d1b\") " pod="openshift-ingress-canary/ingress-canary-2htcq" Jul 13 07:12:26.811304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.811304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-trusted-ca\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.811304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811244 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6297f159-24b8-47e2-ba47-3a43876f9abf-ca-trust-extracted\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.811304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46z6q\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-kube-api-access-46z6q\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.811538 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxvw4\" (UniqueName: \"kubernetes.io/projected/52117e3a-733a-4799-939e-c8eeaa7f2c0d-kube-api-access-qxvw4\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.811538 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-bound-sa-token\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.811538 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.811538 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-certificates\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.811538 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811520 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52117e3a-733a-4799-939e-c8eeaa7f2c0d-tmp-dir\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.811721 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-image-registry-private-configuration\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.811721 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.811603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52117e3a-733a-4799-939e-c8eeaa7f2c0d-config-volume\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.812183 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.812154 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6297f159-24b8-47e2-ba47-3a43876f9abf-ca-trust-extracted\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.812312 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.812236 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52117e3a-733a-4799-939e-c8eeaa7f2c0d-tmp-dir\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.812378 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:26.812345 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:26.812378 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.812353 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52117e3a-733a-4799-939e-c8eeaa7f2c0d-config-volume\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.812463 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.812389 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-certificates\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.812463 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:26.812403 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls podName:52117e3a-733a-4799-939e-c8eeaa7f2c0d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:27.312385177 +0000 UTC m=+36.513162175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls") pod "dns-default-76h2t" (UID: "52117e3a-733a-4799-939e-c8eeaa7f2c0d") : secret "dns-default-metrics-tls" not found Jul 13 07:12:26.812548 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:26.812465 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:26.812548 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:26.812509 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fcc6ff69-krck2: secret "image-registry-tls" not found Jul 13 07:12:26.812635 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:26.812571 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls podName:6297f159-24b8-47e2-ba47-3a43876f9abf nodeName:}" failed. No retries permitted until 2026-07-13 07:12:27.312550803 +0000 UTC m=+36.513327801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls") pod "image-registry-54fcc6ff69-krck2" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf") : secret "image-registry-tls" not found Jul 13 07:12:26.813613 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.813590 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-trusted-ca\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.817309 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.817283 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-image-registry-private-configuration\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.817480 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.817311 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-installation-pull-secrets\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.817776 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.817751 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9db3791-7a75-4fe4-9948-311b6be55d1b-cert\") pod \"ingress-canary-2htcq\" (UID: \"e9db3791-7a75-4fe4-9948-311b6be55d1b\") " pod="openshift-ingress-canary/ingress-canary-2htcq" Jul 13 07:12:26.823723 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.822554 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46z6q\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-kube-api-access-46z6q\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.823723 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.822659 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-bound-sa-token\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:26.823723 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.823024 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67gz5\" (UniqueName: \"kubernetes.io/projected/e9db3791-7a75-4fe4-9948-311b6be55d1b-kube-api-access-67gz5\") pod \"ingress-canary-2htcq\" (UID: \"e9db3791-7a75-4fe4-9948-311b6be55d1b\") " pod="openshift-ingress-canary/ingress-canary-2htcq" Jul 13 07:12:26.823723 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.823125 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxvw4\" (UniqueName: \"kubernetes.io/projected/52117e3a-733a-4799-939e-c8eeaa7f2c0d-kube-api-access-qxvw4\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:26.857860 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.857820 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwrh_4632d1eb-0ae2-467d-9f9a-ff61dae76ec2/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:26.953250 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:26.953152 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2htcq" Jul 13 07:12:27.112657 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:27.112438 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2htcq"] Jul 13 07:12:27.117687 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:27.117643 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9db3791_7a75_4fe4_9948_311b6be55d1b.slice/crio-3f1b61a26150ac96c2cbc293fe4b9583dd73afe01ee56f7c8600baa5f45aebaf WatchSource:0}: Error finding container 3f1b61a26150ac96c2cbc293fe4b9583dd73afe01ee56f7c8600baa5f45aebaf: Status 404 returned error can't find the container with id 3f1b61a26150ac96c2cbc293fe4b9583dd73afe01ee56f7c8600baa5f45aebaf Jul 13 07:12:27.320418 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:27.320369 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:27.320590 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:27.320477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:27.320590 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:27.320561 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:27.320691 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:27.320613 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:27.320691 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:27.320625 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fcc6ff69-krck2: secret "image-registry-tls" not found Jul 13 07:12:27.320691 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:27.320658 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls podName:52117e3a-733a-4799-939e-c8eeaa7f2c0d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:28.32064004 +0000 UTC m=+37.521417035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls") pod "dns-default-76h2t" (UID: "52117e3a-733a-4799-939e-c8eeaa7f2c0d") : secret "dns-default-metrics-tls" not found Jul 13 07:12:27.320691 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:27.320680 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls podName:6297f159-24b8-47e2-ba47-3a43876f9abf nodeName:}" failed. No retries permitted until 2026-07-13 07:12:28.32066722 +0000 UTC m=+37.521444218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls") pod "image-registry-54fcc6ff69-krck2" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf") : secret "image-registry-tls" not found Jul 13 07:12:27.335836 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:27.335796 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:27.338552 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:27.338526 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 07:12:27.338702 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:27.338526 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 07:12:27.338702 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:27.338526 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4492s\"" Jul 13 07:12:27.659194 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:27.659084 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2htcq" event={"ID":"e9db3791-7a75-4fe4-9948-311b6be55d1b","Type":"ContainerStarted","Data":"3f1b61a26150ac96c2cbc293fe4b9583dd73afe01ee56f7c8600baa5f45aebaf"} Jul 13 07:12:28.328374 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:28.328332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:28.328584 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:28.328417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:28.328584 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:28.328518 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:28.328584 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:28.328576 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:28.328744 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:28.328594 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fcc6ff69-krck2: secret "image-registry-tls" not found Jul 13 07:12:28.328744 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:28.328615 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls podName:52117e3a-733a-4799-939e-c8eeaa7f2c0d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:30.328593944 +0000 UTC m=+39.529370939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls") pod "dns-default-76h2t" (UID: "52117e3a-733a-4799-939e-c8eeaa7f2c0d") : secret "dns-default-metrics-tls" not found Jul 13 07:12:28.328744 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:28.328681 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls podName:6297f159-24b8-47e2-ba47-3a43876f9abf nodeName:}" failed. No retries permitted until 2026-07-13 07:12:30.328662417 +0000 UTC m=+39.529439432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls") pod "image-registry-54fcc6ff69-krck2" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf") : secret "image-registry-tls" not found Jul 13 07:12:28.336045 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:28.336015 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:28.336212 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:28.336019 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:28.339518 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:28.339496 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5sc2t\"" Jul 13 07:12:28.339642 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:28.339497 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 07:12:28.339642 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:28.339496 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 07:12:29.668997 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:29.668959 2561 generic.go:356] "Generic (PLEG): container finished" podID="afcd192c-f354-497f-a231-fe321f2f1311" containerID="bf45f020ef760eed25bf4affb794704737249c6e36c9ba98267d58476a82b5cc" exitCode=0 Jul 13 07:12:29.669561 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:29.669052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" event={"ID":"afcd192c-f354-497f-a231-fe321f2f1311","Type":"ContainerDied","Data":"bf45f020ef760eed25bf4affb794704737249c6e36c9ba98267d58476a82b5cc"} Jul 13 07:12:30.345304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:30.345263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:30.345491 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:30.345328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:30.345491 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:30.345437 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:30.345491 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:30.345444 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:30.345664 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:30.345521 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls podName:52117e3a-733a-4799-939e-c8eeaa7f2c0d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:34.345499281 +0000 UTC m=+43.546276294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls") pod "dns-default-76h2t" (UID: "52117e3a-733a-4799-939e-c8eeaa7f2c0d") : secret "dns-default-metrics-tls" not found Jul 13 07:12:30.345664 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:30.345450 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fcc6ff69-krck2: secret "image-registry-tls" not found Jul 13 07:12:30.345664 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:30.345589 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls podName:6297f159-24b8-47e2-ba47-3a43876f9abf nodeName:}" failed. No retries permitted until 2026-07-13 07:12:34.345576458 +0000 UTC m=+43.546353454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls") pod "image-registry-54fcc6ff69-krck2" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf") : secret "image-registry-tls" not found Jul 13 07:12:30.676104 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:30.675986 2561 generic.go:356] "Generic (PLEG): container finished" podID="afcd192c-f354-497f-a231-fe321f2f1311" containerID="cbd2e15d74708ac0626fd25c37c7840c5c5d284e1424ed0825f10fdeb3f2d902" exitCode=0 Jul 13 07:12:30.676104 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:30.676034 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" event={"ID":"afcd192c-f354-497f-a231-fe321f2f1311","Type":"ContainerDied","Data":"cbd2e15d74708ac0626fd25c37c7840c5c5d284e1424ed0825f10fdeb3f2d902"} Jul 13 07:12:31.680613 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:31.680403 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2htcq" event={"ID":"e9db3791-7a75-4fe4-9948-311b6be55d1b","Type":"ContainerStarted","Data":"c5440862e7b3a287d1e25924705db57a400ac1e6c3b4e31d0e0e112eac3562cd"} Jul 13 07:12:31.683913 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:31.683884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" event={"ID":"afcd192c-f354-497f-a231-fe321f2f1311","Type":"ContainerStarted","Data":"f11a564aa2e90b9d1dfa3ae098bfb795d44c8548d26c4d6d40d0cadf48b28a57"} Jul 13 07:12:31.695288 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:31.695234 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2htcq" podStartSLOduration=1.422932844 podStartE2EDuration="5.695219135s" totalImagesPullingTime="4.272286291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:31.694600438 +0000 UTC m=+40.895377454" watchObservedRunningTime="2026-07-13 07:12:31.695219135 +0000 UTC m=+40.895996154" Jul 13 07:12:31.714864 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:31.714789 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ffpgp" podStartSLOduration=9.176716858 podStartE2EDuration="40.71476659s" totalImagesPullingTime="31.538049732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:31.713297881 +0000 UTC m=+40.914074898" watchObservedRunningTime="2026-07-13 07:12:31.71476659 +0000 UTC m=+40.915543611" Jul 13 07:12:33.006751 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.006718 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59"] Jul 13 07:12:33.038714 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.038678 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz"] Jul 13 07:12:33.038911 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.038825 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.041428 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.041398 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nlfpv\"" Jul 13 07:12:33.041570 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.041445 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 13 07:12:33.041570 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.041398 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 13 07:12:33.041570 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.041482 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:12:33.041570 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.041448 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 13 07:12:33.060597 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.060558 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl"] Jul 13 07:12:33.060799 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.060696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz" Jul 13 07:12:33.063136 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.063111 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:12:33.063268 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.063253 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 13 07:12:33.063337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.063297 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8bwct\"" Jul 13 07:12:33.080610 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.080574 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-29tl4"] Jul 13 07:12:33.080772 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.080707 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl" Jul 13 07:12:33.083031 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.083010 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dbfwg\"" Jul 13 07:12:33.102693 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.102660 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl"] Jul 13 07:12:33.102893 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.102707 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59"] Jul 13 07:12:33.102893 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.102729 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz"] Jul 13 07:12:33.102893 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.102747 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-29tl4"] Jul 13 07:12:33.102893 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.102765 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.102893 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.102778 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55"] Jul 13 07:12:33.106205 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.106172 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 13 07:12:33.106390 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.106282 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 13 07:12:33.106390 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.106344 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 13 07:12:33.106630 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.106615 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fbk2k\"" Jul 13 07:12:33.106925 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.106904 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:12:33.112252 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.112231 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 13 07:12:33.124211 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.124182 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rxz9h"] Jul 13 07:12:33.124393 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.124315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:33.128086 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.128033 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 13 07:12:33.128247 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.128094 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 07:12:33.128322 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.128307 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pnhg7\"" Jul 13 07:12:33.128387 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.128334 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 07:12:33.129443 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.129416 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 13 07:12:33.150279 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.150248 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bb4754dc8-h5xv7"] Jul 13 07:12:33.150464 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.150401 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.152959 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.152935 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 07:12:33.153195 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.153005 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 13 07:12:33.153195 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.153163 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-c2d7z\"" Jul 13 07:12:33.153330 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.153227 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 13 07:12:33.153330 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.153275 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 07:12:33.158572 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.158549 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 13 07:12:33.166543 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.166515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2491c05e-614f-4f06-91e0-8397e6209aae-config\") pod \"service-ca-operator-7695fc6c8c-ths59\" (UID: \"2491c05e-614f-4f06-91e0-8397e6209aae\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.166543 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.166546 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ckw7\" (UniqueName: \"kubernetes.io/projected/2491c05e-614f-4f06-91e0-8397e6209aae-kube-api-access-6ckw7\") pod \"service-ca-operator-7695fc6c8c-ths59\" (UID: \"2491c05e-614f-4f06-91e0-8397e6209aae\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.166731 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.166662 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msscl\" (UniqueName: \"kubernetes.io/projected/1cf4de98-d62f-4c5b-8d83-a66721c950d1-kube-api-access-msscl\") pod \"volume-data-source-validator-78495597f6-pgdxz\" (UID: \"1cf4de98-d62f-4c5b-8d83-a66721c950d1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz" Jul 13 07:12:33.166766 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.166739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2491c05e-614f-4f06-91e0-8397e6209aae-serving-cert\") pod \"service-ca-operator-7695fc6c8c-ths59\" (UID: \"2491c05e-614f-4f06-91e0-8397e6209aae\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.169467 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.169445 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc"] Jul 13 07:12:33.169576 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.169560 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.174298 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.174229 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 13 07:12:33.174474 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.174332 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 13 07:12:33.174474 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.174352 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 07:12:33.174592 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.174335 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 13 07:12:33.174820 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.174798 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 07:12:33.174986 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.174959 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 13 07:12:33.175628 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.175614 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qttx5\"" Jul 13 07:12:33.197904 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.197865 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55"] Jul 13 07:12:33.197904 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.197911 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rxz9h"] Jul 13 07:12:33.198130 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.197931 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc"] Jul 13 07:12:33.198130 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.197955 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bb4754dc8-h5xv7"] Jul 13 07:12:33.198130 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.197997 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4j2hm"] Jul 13 07:12:33.198130 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.198012 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:33.200695 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.200670 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 13 07:12:33.200823 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.200705 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 13 07:12:33.200823 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.200752 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:12:33.200954 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.200850 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xpqpg\"" Jul 13 07:12:33.211904 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.211836 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z"] Jul 13 07:12:33.212093 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.211921 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:33.214457 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.214433 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 13 07:12:33.214457 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.214453 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tlbtn\"" Jul 13 07:12:33.214654 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.214433 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 13 07:12:33.230153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.230112 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z"] Jul 13 07:12:33.230153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.230157 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4j2hm"] Jul 13 07:12:33.230371 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.230236 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.232794 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.232771 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:12:33.232922 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.232795 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 13 07:12:33.232922 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.232810 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 13 07:12:33.233015 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.232933 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w58qb\"" Jul 13 07:12:33.233125 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.233112 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 13 07:12:33.267909 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.267815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ed22a84-eb0a-4525-b810-8635e11a5489-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:33.267909 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.267859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2491c05e-614f-4f06-91e0-8397e6209aae-serving-cert\") pod \"service-ca-operator-7695fc6c8c-ths59\" (UID: \"2491c05e-614f-4f06-91e0-8397e6209aae\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.267909 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.267878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9452bd9c-8b2d-4890-ae49-63a71ff19332-tmp\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.268153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.267942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrznb\" (UniqueName: \"kubernetes.io/projected/72183be4-cff0-4144-82bf-9f2eb4e4f463-kube-api-access-nrznb\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.268153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9452bd9c-8b2d-4890-ae49-63a71ff19332-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.268153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-stats-auth\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.268153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.268153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msscl\" (UniqueName: \"kubernetes.io/projected/1cf4de98-d62f-4c5b-8d83-a66721c950d1-kube-api-access-msscl\") pod \"volume-data-source-validator-78495597f6-pgdxz\" (UID: \"1cf4de98-d62f-4c5b-8d83-a66721c950d1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz" Jul 13 07:12:33.268153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72183be4-cff0-4144-82bf-9f2eb4e4f463-config\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.268153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268144 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.268383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-default-certificate\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.268383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268185 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggbsf\" (UniqueName: \"kubernetes.io/projected/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-kube-api-access-ggbsf\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.268383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6dql\" (UniqueName: \"kubernetes.io/projected/3ed22a84-eb0a-4525-b810-8635e11a5489-kube-api-access-q6dql\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:33.268383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9452bd9c-8b2d-4890-ae49-63a71ff19332-snapshots\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.268383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9452bd9c-8b2d-4890-ae49-63a71ff19332-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.268383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72183be4-cff0-4144-82bf-9f2eb4e4f463-trusted-ca\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.268383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268378 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shv8w\" (UniqueName: \"kubernetes.io/projected/9452bd9c-8b2d-4890-ae49-63a71ff19332-kube-api-access-shv8w\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.268651 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2491c05e-614f-4f06-91e0-8397e6209aae-config\") pod \"service-ca-operator-7695fc6c8c-ths59\" (UID: \"2491c05e-614f-4f06-91e0-8397e6209aae\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.268651 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ckw7\" (UniqueName: \"kubernetes.io/projected/2491c05e-614f-4f06-91e0-8397e6209aae-kube-api-access-6ckw7\") pod \"service-ca-operator-7695fc6c8c-ths59\" (UID: \"2491c05e-614f-4f06-91e0-8397e6209aae\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.268651 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268459 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpm4q\" (UniqueName: \"kubernetes.io/projected/0d981a2d-0547-4b2e-b3fa-0de0528f7d28-kube-api-access-rpm4q\") pod \"network-check-source-869dcfcdcd-l8ggl\" (UID: \"0d981a2d-0547-4b2e-b3fa-0de0528f7d28\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl" Jul 13 07:12:33.268651 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72183be4-cff0-4144-82bf-9f2eb4e4f463-serving-cert\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.268651 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9452bd9c-8b2d-4890-ae49-63a71ff19332-serving-cert\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.268651 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:33.268961 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.268944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2491c05e-614f-4f06-91e0-8397e6209aae-config\") pod \"service-ca-operator-7695fc6c8c-ths59\" (UID: \"2491c05e-614f-4f06-91e0-8397e6209aae\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.272260 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.272241 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2491c05e-614f-4f06-91e0-8397e6209aae-serving-cert\") pod \"service-ca-operator-7695fc6c8c-ths59\" (UID: \"2491c05e-614f-4f06-91e0-8397e6209aae\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.277093 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.277046 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ckw7\" (UniqueName: \"kubernetes.io/projected/2491c05e-614f-4f06-91e0-8397e6209aae-kube-api-access-6ckw7\") pod \"service-ca-operator-7695fc6c8c-ths59\" (UID: \"2491c05e-614f-4f06-91e0-8397e6209aae\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.277276 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.277255 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msscl\" (UniqueName: \"kubernetes.io/projected/1cf4de98-d62f-4c5b-8d83-a66721c950d1-kube-api-access-msscl\") pod \"volume-data-source-validator-78495597f6-pgdxz\" (UID: \"1cf4de98-d62f-4c5b-8d83-a66721c950d1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz" Jul 13 07:12:33.348833 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.348793 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" Jul 13 07:12:33.369005 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.368968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz" Jul 13 07:12:33.369253 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9452bd9c-8b2d-4890-ae49-63a71ff19332-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.369329 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-stats-auth\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.369329 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.369434 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:33.369434 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72183be4-cff0-4144-82bf-9f2eb4e4f463-config\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.369434 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369424 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wj68z\" (UID: \"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.369568 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.369568 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.369470 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 07:12:33.369568 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-default-certificate\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.369568 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggbsf\" (UniqueName: \"kubernetes.io/projected/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-kube-api-access-ggbsf\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.369568 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.369542 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:33.86951896 +0000 UTC m=+43.070295975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : secret "router-metrics-certs-default" not found Jul 13 07:12:33.369798 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.369608 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:33.869590005 +0000 UTC m=+43.070367001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : configmap references non-existent config key: service-ca.crt Jul 13 07:12:33.369798 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6dql\" (UniqueName: \"kubernetes.io/projected/3ed22a84-eb0a-4525-b810-8635e11a5489-kube-api-access-q6dql\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:33.369798 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9452bd9c-8b2d-4890-ae49-63a71ff19332-snapshots\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.369798 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9452bd9c-8b2d-4890-ae49-63a71ff19332-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.369798 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369723 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72183be4-cff0-4144-82bf-9f2eb4e4f463-trusted-ca\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.369798 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shv8w\" (UniqueName: \"kubernetes.io/projected/9452bd9c-8b2d-4890-ae49-63a71ff19332-kube-api-access-shv8w\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.369798 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpm4q\" (UniqueName: \"kubernetes.io/projected/0d981a2d-0547-4b2e-b3fa-0de0528f7d28-kube-api-access-rpm4q\") pod \"network-check-source-869dcfcdcd-l8ggl\" (UID: \"0d981a2d-0547-4b2e-b3fa-0de0528f7d28\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl" Jul 13 07:12:33.370182 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0145d54b-4d41-49a0-b0e0-7099ddcd9095-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:33.370182 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72183be4-cff0-4144-82bf-9f2eb4e4f463-serving-cert\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.370182 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.369912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9452bd9c-8b2d-4890-ae49-63a71ff19332-serving-cert\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.370364 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370344 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9452bd9c-8b2d-4890-ae49-63a71ff19332-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.370427 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370378 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9452bd9c-8b2d-4890-ae49-63a71ff19332-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.370480 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370439 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72183be4-cff0-4144-82bf-9f2eb4e4f463-config\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.370533 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370492 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:33.370583 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wj68z\" (UID: \"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.370583 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370559 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtg2j\" (UniqueName: \"kubernetes.io/projected/f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7-kube-api-access-xtg2j\") pod \"kube-storage-version-migrator-operator-799cb7f958-wj68z\" (UID: \"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.370688 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltspz\" (UniqueName: \"kubernetes.io/projected/2889d9ab-9b2e-4906-9864-11bca26adb6d-kube-api-access-ltspz\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:33.370688 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:33.370688 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.370665 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:33.370688 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ed22a84-eb0a-4525-b810-8635e11a5489-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:33.370883 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9452bd9c-8b2d-4890-ae49-63a71ff19332-tmp\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.370883 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.370729 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls podName:3ed22a84-eb0a-4525-b810-8635e11a5489 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:33.870712675 +0000 UTC m=+43.071489686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkv55" (UID: "3ed22a84-eb0a-4525-b810-8635e11a5489") : secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:33.370883 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrznb\" (UniqueName: \"kubernetes.io/projected/72183be4-cff0-4144-82bf-9f2eb4e4f463-kube-api-access-nrznb\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.371019 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.370946 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9452bd9c-8b2d-4890-ae49-63a71ff19332-tmp\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.371108 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.371087 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72183be4-cff0-4144-82bf-9f2eb4e4f463-trusted-ca\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.371178 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.371151 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9452bd9c-8b2d-4890-ae49-63a71ff19332-snapshots\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.371700 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.371679 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ed22a84-eb0a-4525-b810-8635e11a5489-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:33.372511 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.372489 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-stats-auth\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.372787 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.372765 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-default-certificate\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.372895 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.372879 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72183be4-cff0-4144-82bf-9f2eb4e4f463-serving-cert\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.373262 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.373247 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9452bd9c-8b2d-4890-ae49-63a71ff19332-serving-cert\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.378772 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.378743 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6dql\" (UniqueName: \"kubernetes.io/projected/3ed22a84-eb0a-4525-b810-8635e11a5489-kube-api-access-q6dql\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:33.379281 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.379258 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggbsf\" (UniqueName: \"kubernetes.io/projected/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-kube-api-access-ggbsf\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.380155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.380105 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrznb\" (UniqueName: \"kubernetes.io/projected/72183be4-cff0-4144-82bf-9f2eb4e4f463-kube-api-access-nrznb\") pod \"console-operator-7866497494-29tl4\" (UID: \"72183be4-cff0-4144-82bf-9f2eb4e4f463\") " pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.380155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.380137 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpm4q\" (UniqueName: \"kubernetes.io/projected/0d981a2d-0547-4b2e-b3fa-0de0528f7d28-kube-api-access-rpm4q\") pod \"network-check-source-869dcfcdcd-l8ggl\" (UID: \"0d981a2d-0547-4b2e-b3fa-0de0528f7d28\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl" Jul 13 07:12:33.380679 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.380651 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shv8w\" (UniqueName: \"kubernetes.io/projected/9452bd9c-8b2d-4890-ae49-63a71ff19332-kube-api-access-shv8w\") pod \"insights-operator-68d9dd94cf-rxz9h\" (UID: \"9452bd9c-8b2d-4890-ae49-63a71ff19332\") " pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.390094 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.390031 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl" Jul 13 07:12:33.413839 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.413819 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:33.460669 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.460583 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" Jul 13 07:12:33.471888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.471810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:33.471888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.471848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wj68z\" (UID: \"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.472141 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.472009 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 07:12:33.472141 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.472094 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls podName:2889d9ab-9b2e-4906-9864-11bca26adb6d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:33.972054043 +0000 UTC m=+43.172831039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls") pod "cluster-samples-operator-65db858894-hbnvc" (UID: "2889d9ab-9b2e-4906-9864-11bca26adb6d") : secret "samples-operator-tls" not found Jul 13 07:12:33.472249 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.472197 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0145d54b-4d41-49a0-b0e0-7099ddcd9095-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:33.472305 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.472274 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wj68z\" (UID: \"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.472351 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.472303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtg2j\" (UniqueName: \"kubernetes.io/projected/f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7-kube-api-access-xtg2j\") pod \"kube-storage-version-migrator-operator-799cb7f958-wj68z\" (UID: \"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.472400 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.472349 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltspz\" (UniqueName: \"kubernetes.io/projected/2889d9ab-9b2e-4906-9864-11bca26adb6d-kube-api-access-ltspz\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:33.472400 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.472380 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:33.472773 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.472493 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wj68z\" (UID: \"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.472773 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.472520 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 07:12:33.472773 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.472570 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert podName:0145d54b-4d41-49a0-b0e0-7099ddcd9095 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:33.972554622 +0000 UTC m=+43.173331618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4j2hm" (UID: "0145d54b-4d41-49a0-b0e0-7099ddcd9095") : secret "networking-console-plugin-cert" not found Jul 13 07:12:33.473009 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.472977 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0145d54b-4d41-49a0-b0e0-7099ddcd9095-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:33.475478 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.475452 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wj68z\" (UID: \"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.486345 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.486311 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtg2j\" (UniqueName: \"kubernetes.io/projected/f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7-kube-api-access-xtg2j\") pod \"kube-storage-version-migrator-operator-799cb7f958-wj68z\" (UID: \"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.486499 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.486397 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltspz\" (UniqueName: \"kubernetes.io/projected/2889d9ab-9b2e-4906-9864-11bca26adb6d-kube-api-access-ltspz\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:33.534191 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.534099 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59"] Jul 13 07:12:33.543355 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.539690 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" Jul 13 07:12:33.549118 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:33.549040 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2491c05e_614f_4f06_91e0_8397e6209aae.slice/crio-1fcba4c705af063d822176ca77bb2d44d9d2b253319e94ac7864de181d1a1866 WatchSource:0}: Error finding container 1fcba4c705af063d822176ca77bb2d44d9d2b253319e94ac7864de181d1a1866: Status 404 returned error can't find the container with id 1fcba4c705af063d822176ca77bb2d44d9d2b253319e94ac7864de181d1a1866 Jul 13 07:12:33.689725 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.689684 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" event={"ID":"2491c05e-614f-4f06-91e0-8397e6209aae","Type":"ContainerStarted","Data":"1fcba4c705af063d822176ca77bb2d44d9d2b253319e94ac7864de181d1a1866"} Jul 13 07:12:33.757766 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.757730 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z"] Jul 13 07:12:33.760903 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:33.760870 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d546c3_0d9f_42b2_8206_7a4f6e0b7bf7.slice/crio-a9cab0b4614c4ed058379cc8f63c620779e74722908a5dd11f455957d530163b WatchSource:0}: Error finding container a9cab0b4614c4ed058379cc8f63c620779e74722908a5dd11f455957d530163b: Status 404 returned error can't find the container with id a9cab0b4614c4ed058379cc8f63c620779e74722908a5dd11f455957d530163b Jul 13 07:12:33.807961 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.807880 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz"] Jul 13 07:12:33.810862 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:33.810831 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf4de98_d62f_4c5b_8d83_a66721c950d1.slice/crio-a0ee7152cf78f3edc8a0f62307a34b58a66fbdff5445b1ed9cffe540f17cccb2 WatchSource:0}: Error finding container a0ee7152cf78f3edc8a0f62307a34b58a66fbdff5445b1ed9cffe540f17cccb2: Status 404 returned error can't find the container with id a0ee7152cf78f3edc8a0f62307a34b58a66fbdff5445b1ed9cffe540f17cccb2 Jul 13 07:12:33.876791 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.876740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:33.876969 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.876855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.876969 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.876905 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:33.877104 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.876910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:33.877104 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.876973 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls podName:3ed22a84-eb0a-4525-b810-8635e11a5489 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:34.876954444 +0000 UTC m=+44.077731457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkv55" (UID: "3ed22a84-eb0a-4525-b810-8635e11a5489") : secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:33.877104 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.877016 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 07:12:33.877104 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.877090 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:34.877034978 +0000 UTC m=+44.077811974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : configmap references non-existent config key: service-ca.crt Jul 13 07:12:33.877255 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.877114 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:34.877102809 +0000 UTC m=+44.077879806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : secret "router-metrics-certs-default" not found Jul 13 07:12:33.914023 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.913974 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl"] Jul 13 07:12:33.915522 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.915423 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-29tl4"] Jul 13 07:12:33.916585 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.916522 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rxz9h"] Jul 13 07:12:33.917457 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:33.917433 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d981a2d_0547_4b2e_b3fa_0de0528f7d28.slice/crio-fbc40ba3e5b6e24e206c297eb348f06e1101ad87050be698e94402e061d530ff WatchSource:0}: Error finding container fbc40ba3e5b6e24e206c297eb348f06e1101ad87050be698e94402e061d530ff: Status 404 returned error can't find the container with id fbc40ba3e5b6e24e206c297eb348f06e1101ad87050be698e94402e061d530ff Jul 13 07:12:33.918006 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:33.917983 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72183be4_cff0_4144_82bf_9f2eb4e4f463.slice/crio-b7dcae2ee5f7b3f10ea464bb0711ac2ef7ca74fdd437fbe8a9afca421dc8de80 WatchSource:0}: Error finding container b7dcae2ee5f7b3f10ea464bb0711ac2ef7ca74fdd437fbe8a9afca421dc8de80: Status 404 returned error can't find the container with id b7dcae2ee5f7b3f10ea464bb0711ac2ef7ca74fdd437fbe8a9afca421dc8de80 Jul 13 07:12:33.919334 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:33.919252 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9452bd9c_8b2d_4890_ae49_63a71ff19332.slice/crio-e93f7982e09e47fc4c8be7fab9b245f2296fbc54112fdddd9cb931301f5285ef WatchSource:0}: Error finding container e93f7982e09e47fc4c8be7fab9b245f2296fbc54112fdddd9cb931301f5285ef: Status 404 returned error can't find the container with id e93f7982e09e47fc4c8be7fab9b245f2296fbc54112fdddd9cb931301f5285ef Jul 13 07:12:33.977845 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.977795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:33.978016 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:33.977926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:33.978016 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.977963 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 07:12:33.978120 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.978030 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls podName:2889d9ab-9b2e-4906-9864-11bca26adb6d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:34.978013588 +0000 UTC m=+44.178790588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls") pod "cluster-samples-operator-65db858894-hbnvc" (UID: "2889d9ab-9b2e-4906-9864-11bca26adb6d") : secret "samples-operator-tls" not found Jul 13 07:12:33.978120 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.978038 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 07:12:33.978120 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:33.978113 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert podName:0145d54b-4d41-49a0-b0e0-7099ddcd9095 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:34.978100473 +0000 UTC m=+44.178877468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4j2hm" (UID: "0145d54b-4d41-49a0-b0e0-7099ddcd9095") : secret "networking-console-plugin-cert" not found Jul 13 07:12:34.382258 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.382216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:34.382710 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.382276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:34.382710 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.382379 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:34.382710 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.382446 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls podName:52117e3a-733a-4799-939e-c8eeaa7f2c0d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:42.38242574 +0000 UTC m=+51.583202735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls") pod "dns-default-76h2t" (UID: "52117e3a-733a-4799-939e-c8eeaa7f2c0d") : secret "dns-default-metrics-tls" not found Jul 13 07:12:34.382710 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.382507 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:34.382710 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.382533 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fcc6ff69-krck2: secret "image-registry-tls" not found Jul 13 07:12:34.382710 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.382595 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls podName:6297f159-24b8-47e2-ba47-3a43876f9abf nodeName:}" failed. No retries permitted until 2026-07-13 07:12:42.382574846 +0000 UTC m=+51.583351859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls") pod "image-registry-54fcc6ff69-krck2" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf") : secret "image-registry-tls" not found Jul 13 07:12:34.695697 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.695496 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" event={"ID":"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7","Type":"ContainerStarted","Data":"a9cab0b4614c4ed058379cc8f63c620779e74722908a5dd11f455957d530163b"} Jul 13 07:12:34.698346 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.698247 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" event={"ID":"9452bd9c-8b2d-4890-ae49-63a71ff19332","Type":"ContainerStarted","Data":"e93f7982e09e47fc4c8be7fab9b245f2296fbc54112fdddd9cb931301f5285ef"} Jul 13 07:12:34.701990 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.701890 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl" event={"ID":"0d981a2d-0547-4b2e-b3fa-0de0528f7d28","Type":"ContainerStarted","Data":"fbc40ba3e5b6e24e206c297eb348f06e1101ad87050be698e94402e061d530ff"} Jul 13 07:12:34.704509 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.704413 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-29tl4" event={"ID":"72183be4-cff0-4144-82bf-9f2eb4e4f463","Type":"ContainerStarted","Data":"b7dcae2ee5f7b3f10ea464bb0711ac2ef7ca74fdd437fbe8a9afca421dc8de80"} Jul 13 07:12:34.706651 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.706573 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz" event={"ID":"1cf4de98-d62f-4c5b-8d83-a66721c950d1","Type":"ContainerStarted","Data":"a0ee7152cf78f3edc8a0f62307a34b58a66fbdff5445b1ed9cffe540f17cccb2"} Jul 13 07:12:34.887653 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.887616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:34.887854 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.887705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:34.887854 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.887737 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:34.887967 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.887877 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:36.887857198 +0000 UTC m=+46.088634212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : configmap references non-existent config key: service-ca.crt Jul 13 07:12:34.888370 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.888179 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 07:12:34.888370 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.888249 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:36.888229517 +0000 UTC m=+46.089006518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : secret "router-metrics-certs-default" not found Jul 13 07:12:34.888370 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.888317 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:34.888370 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.888354 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls podName:3ed22a84-eb0a-4525-b810-8635e11a5489 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:36.888342677 +0000 UTC m=+46.089119675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkv55" (UID: "3ed22a84-eb0a-4525-b810-8635e11a5489") : secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:34.988658 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.988616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:34.988840 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:34.988764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:34.988840 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.988796 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 07:12:34.988965 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.988873 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls podName:2889d9ab-9b2e-4906-9864-11bca26adb6d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:36.988852352 +0000 UTC m=+46.189629353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls") pod "cluster-samples-operator-65db858894-hbnvc" (UID: "2889d9ab-9b2e-4906-9864-11bca26adb6d") : secret "samples-operator-tls" not found Jul 13 07:12:34.988965 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.988878 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 07:12:34.988965 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:34.988923 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert podName:0145d54b-4d41-49a0-b0e0-7099ddcd9095 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:36.988907763 +0000 UTC m=+46.189684758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4j2hm" (UID: "0145d54b-4d41-49a0-b0e0-7099ddcd9095") : secret "networking-console-plugin-cert" not found Jul 13 07:12:36.908402 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:36.908312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:36.908895 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:36.908432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:36.908895 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:36.908500 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:40.908477654 +0000 UTC m=+50.109254653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : configmap references non-existent config key: service-ca.crt Jul 13 07:12:36.908895 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:36.908577 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:36.908895 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:36.908579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:36.908895 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:36.908630 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls podName:3ed22a84-eb0a-4525-b810-8635e11a5489 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:40.908614503 +0000 UTC m=+50.109391511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkv55" (UID: "3ed22a84-eb0a-4525-b810-8635e11a5489") : secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:36.908895 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:36.908701 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 07:12:36.908895 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:36.908744 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:40.908732528 +0000 UTC m=+50.109509527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : secret "router-metrics-certs-default" not found Jul 13 07:12:37.009468 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:37.009425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:37.009650 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:37.009570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:37.009650 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:37.009569 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 07:12:37.009723 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:37.009624 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 07:12:37.009723 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:37.009682 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls podName:2889d9ab-9b2e-4906-9864-11bca26adb6d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:41.00966686 +0000 UTC m=+50.210443858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls") pod "cluster-samples-operator-65db858894-hbnvc" (UID: "2889d9ab-9b2e-4906-9864-11bca26adb6d") : secret "samples-operator-tls" not found Jul 13 07:12:37.009790 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:37.009742 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert podName:0145d54b-4d41-49a0-b0e0-7099ddcd9095 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:41.009727363 +0000 UTC m=+50.210504360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4j2hm" (UID: "0145d54b-4d41-49a0-b0e0-7099ddcd9095") : secret "networking-console-plugin-cert" not found Jul 13 07:12:40.727088 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.727030 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" event={"ID":"2491c05e-614f-4f06-91e0-8397e6209aae","Type":"ContainerStarted","Data":"3c5274befb29fa0f1a2a2c47929874f2d91017f7f8ba1968d91bbd0fb814b212"} Jul 13 07:12:40.728901 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.728855 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" event={"ID":"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7","Type":"ContainerStarted","Data":"4d00cba74ac76aa6763692e41715fee979f8a2b769c8ad3dfa3683970bc2fd69"} Jul 13 07:12:40.730639 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.730608 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" event={"ID":"9452bd9c-8b2d-4890-ae49-63a71ff19332","Type":"ContainerStarted","Data":"65f96498f7166146fa1891f3a14cbbdd576324fdb81f0a02e8284da9e44bf203"} Jul 13 07:12:40.732612 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.732557 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl" event={"ID":"0d981a2d-0547-4b2e-b3fa-0de0528f7d28","Type":"ContainerStarted","Data":"32a4a52694ed899cc8035f2410a2c28a5f69c19890fcd0a0b064171ea7280da2"} Jul 13 07:12:40.734608 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.734586 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/0.log" Jul 13 07:12:40.734738 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.734625 2561 generic.go:356] "Generic (PLEG): container finished" podID="72183be4-cff0-4144-82bf-9f2eb4e4f463" containerID="be973c26c2360dcf8c4741f21e6665fdf1fa69cd369a8b488c0b1885b298a402" exitCode=255 Jul 13 07:12:40.734738 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.734685 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-29tl4" event={"ID":"72183be4-cff0-4144-82bf-9f2eb4e4f463","Type":"ContainerDied","Data":"be973c26c2360dcf8c4741f21e6665fdf1fa69cd369a8b488c0b1885b298a402"} Jul 13 07:12:40.734906 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.734891 2561 scope.go:117] "RemoveContainer" containerID="be973c26c2360dcf8c4741f21e6665fdf1fa69cd369a8b488c0b1885b298a402" Jul 13 07:12:40.736420 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.736371 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz" event={"ID":"1cf4de98-d62f-4c5b-8d83-a66721c950d1","Type":"ContainerStarted","Data":"127f2011581ddcafcd7f9f95a681acac233e5c358bfa46661a1892723421d468"} Jul 13 07:12:40.741157 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.741082 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" podStartSLOduration=2.20037832 podStartE2EDuration="8.741043118s" totalImagesPullingTime="6.540664798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:40.74098813 +0000 UTC m=+49.941765148" watchObservedRunningTime="2026-07-13 07:12:40.741043118 +0000 UTC m=+49.941820135" Jul 13 07:12:40.776032 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.775979 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" podStartSLOduration=1.4455353 podStartE2EDuration="7.775962004s" totalImagesPullingTime="6.330426704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:40.758266747 +0000 UTC m=+49.959043782" watchObservedRunningTime="2026-07-13 07:12:40.775962004 +0000 UTC m=+49.976739020" Jul 13 07:12:40.777404 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.777096 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pgdxz" podStartSLOduration=2.5383779090000003 podStartE2EDuration="8.777052557s" totalImagesPullingTime="6.238674648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:40.775746459 +0000 UTC m=+49.976523478" watchObservedRunningTime="2026-07-13 07:12:40.777052557 +0000 UTC m=+49.977829575" Jul 13 07:12:40.792388 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.791444 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l8ggl" podStartSLOduration=2.607966145 podStartE2EDuration="8.791427806s" totalImagesPullingTime="6.183461661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:40.79034117 +0000 UTC m=+49.991118187" watchObservedRunningTime="2026-07-13 07:12:40.791427806 +0000 UTC m=+49.992204823" Jul 13 07:12:40.829685 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.829622 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" podStartSLOduration=1.65904992 podStartE2EDuration="7.829597707s" totalImagesPullingTime="6.170547787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:40.828931285 +0000 UTC m=+50.029708303" watchObservedRunningTime="2026-07-13 07:12:40.829597707 +0000 UTC m=+50.030374728" Jul 13 07:12:40.950477 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.950436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:40.950660 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.950554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:40.950660 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:40.950605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:40.950660 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:40.950624 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:40.950860 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:40.950707 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 07:12:40.950860 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:40.950717 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls podName:3ed22a84-eb0a-4525-b810-8635e11a5489 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:48.950694458 +0000 UTC m=+58.151471459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkv55" (UID: "3ed22a84-eb0a-4525-b810-8635e11a5489") : secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:40.950860 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:40.950781 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:48.950762789 +0000 UTC m=+58.151539793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : configmap references non-existent config key: service-ca.crt Jul 13 07:12:40.950860 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:40.950799 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:48.950788851 +0000 UTC m=+58.151565848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : secret "router-metrics-certs-default" not found Jul 13 07:12:41.051507 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.051404 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:41.051692 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.051521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:41.051692 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.051581 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 07:12:41.051692 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.051658 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert podName:0145d54b-4d41-49a0-b0e0-7099ddcd9095 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:49.051637456 +0000 UTC m=+58.252414456 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4j2hm" (UID: "0145d54b-4d41-49a0-b0e0-7099ddcd9095") : secret "networking-console-plugin-cert" not found Jul 13 07:12:41.051848 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.051722 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 07:12:41.051848 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.051774 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls podName:2889d9ab-9b2e-4906-9864-11bca26adb6d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:49.051758098 +0000 UTC m=+58.252535097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls") pod "cluster-samples-operator-65db858894-hbnvc" (UID: "2889d9ab-9b2e-4906-9864-11bca26adb6d") : secret "samples-operator-tls" not found Jul 13 07:12:41.291584 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.290090 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k4bmz"] Jul 13 07:12:41.307891 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.307804 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k4bmz"] Jul 13 07:12:41.308080 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.307953 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.310351 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.310328 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 07:12:41.310750 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.310559 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 07:12:41.310919 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.310897 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8g2nr\"" Jul 13 07:12:41.354449 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.354411 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fc2478d-9e86-4364-8c04-4e7f20563244-crio-socket\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.354449 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.354457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fc2478d-9e86-4364-8c04-4e7f20563244-data-volume\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.354707 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.354494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8rc2\" (UniqueName: \"kubernetes.io/projected/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-api-access-m8rc2\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.354707 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.354652 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.354816 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.354740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.455155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.455106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.455155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.455165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.455409 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.455253 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 07:12:41.455409 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.455278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fc2478d-9e86-4364-8c04-4e7f20563244-crio-socket\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.455409 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.455304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fc2478d-9e86-4364-8c04-4e7f20563244-data-volume\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.455409 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.455332 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm podName:2fc2478d-9e86-4364-8c04-4e7f20563244 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:41.955304994 +0000 UTC m=+51.156082009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k4bmz" (UID: "2fc2478d-9e86-4364-8c04-4e7f20563244") : configmap "kube-rbac-proxy" not found Jul 13 07:12:41.455409 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.455397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8rc2\" (UniqueName: \"kubernetes.io/projected/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-api-access-m8rc2\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.455680 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.455396 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fc2478d-9e86-4364-8c04-4e7f20563244-crio-socket\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.455680 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.455627 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fc2478d-9e86-4364-8c04-4e7f20563244-data-volume\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.455680 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.455656 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 07:12:41.455867 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.455720 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls podName:2fc2478d-9e86-4364-8c04-4e7f20563244 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:41.955702691 +0000 UTC m=+51.156479686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k4bmz" (UID: "2fc2478d-9e86-4364-8c04-4e7f20563244") : secret "insights-runtime-extractor-tls" not found Jul 13 07:12:41.467366 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.467330 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8rc2\" (UniqueName: \"kubernetes.io/projected/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-api-access-m8rc2\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.743081 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.743035 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:12:41.743570 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.743552 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/0.log" Jul 13 07:12:41.743659 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.743590 2561 generic.go:356] "Generic (PLEG): container finished" podID="72183be4-cff0-4144-82bf-9f2eb4e4f463" containerID="e6d0942e89076abec34f38497fe58a5edd0a034cbb8cbe22baeb79207e309ccf" exitCode=255 Jul 13 07:12:41.744573 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.744554 2561 scope.go:117] "RemoveContainer" containerID="e6d0942e89076abec34f38497fe58a5edd0a034cbb8cbe22baeb79207e309ccf" Jul 13 07:12:41.744851 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.744821 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-29tl4_openshift-console-operator(72183be4-cff0-4144-82bf-9f2eb4e4f463)\"" pod="openshift-console-operator/console-operator-7866497494-29tl4" podUID="72183be4-cff0-4144-82bf-9f2eb4e4f463" Jul 13 07:12:41.744964 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.744842 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-29tl4" event={"ID":"72183be4-cff0-4144-82bf-9f2eb4e4f463","Type":"ContainerDied","Data":"e6d0942e89076abec34f38497fe58a5edd0a034cbb8cbe22baeb79207e309ccf"} Jul 13 07:12:41.744964 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.744916 2561 scope.go:117] "RemoveContainer" containerID="be973c26c2360dcf8c4741f21e6665fdf1fa69cd369a8b488c0b1885b298a402" Jul 13 07:12:41.961652 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.961608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.961834 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:41.961672 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:41.961834 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.961735 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 07:12:41.961834 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.961777 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 07:12:41.961834 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.961806 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm podName:2fc2478d-9e86-4364-8c04-4e7f20563244 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:42.961787471 +0000 UTC m=+52.162564466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k4bmz" (UID: "2fc2478d-9e86-4364-8c04-4e7f20563244") : configmap "kube-rbac-proxy" not found Jul 13 07:12:41.961834 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:41.961826 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls podName:2fc2478d-9e86-4364-8c04-4e7f20563244 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:42.961812645 +0000 UTC m=+52.162589640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k4bmz" (UID: "2fc2478d-9e86-4364-8c04-4e7f20563244") : secret "insights-runtime-extractor-tls" not found Jul 13 07:12:42.465528 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:42.465481 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:42.465743 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:42.465542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:42.465743 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:42.465636 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:42.465743 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:42.465675 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:42.465743 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:42.465691 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fcc6ff69-krck2: secret "image-registry-tls" not found Jul 13 07:12:42.465743 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:42.465707 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls podName:52117e3a-733a-4799-939e-c8eeaa7f2c0d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:58.465691841 +0000 UTC m=+67.666468836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls") pod "dns-default-76h2t" (UID: "52117e3a-733a-4799-939e-c8eeaa7f2c0d") : secret "dns-default-metrics-tls" not found Jul 13 07:12:42.465743 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:42.465735 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls podName:6297f159-24b8-47e2-ba47-3a43876f9abf nodeName:}" failed. No retries permitted until 2026-07-13 07:12:58.465721245 +0000 UTC m=+67.666498254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls") pod "image-registry-54fcc6ff69-krck2" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf") : secret "image-registry-tls" not found Jul 13 07:12:42.721618 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:42.721536 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2n9c_4b19fff5-4887-4c03-b55e-d3ce73693c53/dns-node-resolver/0.log" Jul 13 07:12:42.747877 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:42.747849 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:12:42.748327 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:42.748242 2561 scope.go:117] "RemoveContainer" containerID="e6d0942e89076abec34f38497fe58a5edd0a034cbb8cbe22baeb79207e309ccf" Jul 13 07:12:42.748415 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:42.748395 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-29tl4_openshift-console-operator(72183be4-cff0-4144-82bf-9f2eb4e4f463)\"" pod="openshift-console-operator/console-operator-7866497494-29tl4" podUID="72183be4-cff0-4144-82bf-9f2eb4e4f463" Jul 13 07:12:42.970233 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:42.970191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:42.970502 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:42.970245 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:42.970502 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:42.970272 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 07:12:42.970502 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:42.970344 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 07:12:42.970502 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:42.970359 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm podName:2fc2478d-9e86-4364-8c04-4e7f20563244 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:44.970337661 +0000 UTC m=+54.171114655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k4bmz" (UID: "2fc2478d-9e86-4364-8c04-4e7f20563244") : configmap "kube-rbac-proxy" not found Jul 13 07:12:42.970502 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:42.970382 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls podName:2fc2478d-9e86-4364-8c04-4e7f20563244 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:44.970371086 +0000 UTC m=+54.171148082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k4bmz" (UID: "2fc2478d-9e86-4364-8c04-4e7f20563244") : secret "insights-runtime-extractor-tls" not found Jul 13 07:12:43.414823 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:43.414780 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:43.415113 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:43.414841 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:43.750989 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:43.750964 2561 scope.go:117] "RemoveContainer" containerID="e6d0942e89076abec34f38497fe58a5edd0a034cbb8cbe22baeb79207e309ccf" Jul 13 07:12:43.751389 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:43.751151 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-29tl4_openshift-console-operator(72183be4-cff0-4144-82bf-9f2eb4e4f463)\"" pod="openshift-console-operator/console-operator-7866497494-29tl4" podUID="72183be4-cff0-4144-82bf-9f2eb4e4f463" Jul 13 07:12:44.121676 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:44.121599 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wstkx_447beb12-e780-49da-bf7a-09ecc1ddb5ee/node-ca/0.log" Jul 13 07:12:44.521384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:44.521321 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2htcq_e9db3791-7a75-4fe4-9948-311b6be55d1b/serve-healthcheck-canary/0.log" Jul 13 07:12:44.993648 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:44.993600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:44.994052 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:44.993672 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:44.994052 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:44.993810 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 07:12:44.994052 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:44.993878 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls podName:2fc2478d-9e86-4364-8c04-4e7f20563244 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:48.993863556 +0000 UTC m=+58.194640550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k4bmz" (UID: "2fc2478d-9e86-4364-8c04-4e7f20563244") : secret "insights-runtime-extractor-tls" not found Jul 13 07:12:44.994239 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:44.994215 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fc2478d-9e86-4364-8c04-4e7f20563244-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:49.030384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:49.030338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:12:49.030912 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:49.030398 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:49.030912 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:49.030489 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 07:12:49.030912 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:49.030492 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:49.030912 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:49.030554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:49.030912 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:49.030565 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls podName:2fc2478d-9e86-4364-8c04-4e7f20563244 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:57.030546901 +0000 UTC m=+66.231323898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k4bmz" (UID: "2fc2478d-9e86-4364-8c04-4e7f20563244") : secret "insights-runtime-extractor-tls" not found Jul 13 07:12:49.030912 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:49.030623 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 07:12:49.030912 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:49.030639 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls podName:3ed22a84-eb0a-4525-b810-8635e11a5489 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:05.030621414 +0000 UTC m=+74.231398411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkv55" (UID: "3ed22a84-eb0a-4525-b810-8635e11a5489") : secret "cluster-monitoring-operator-tls" not found Jul 13 07:12:49.030912 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:49.030663 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:05.030651343 +0000 UTC m=+74.231428338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : secret "router-metrics-certs-default" not found Jul 13 07:12:49.030912 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:49.030702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:12:49.030912 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:49.030789 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle podName:f63c2209-ae62-4ed9-ae55-d0cf4a26b496 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:05.030782245 +0000 UTC m=+74.231559240 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle") pod "router-default-6bb4754dc8-h5xv7" (UID: "f63c2209-ae62-4ed9-ae55-d0cf4a26b496") : configmap references non-existent config key: service-ca.crt Jul 13 07:12:49.131784 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:49.131745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:12:49.131967 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:49.131836 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:49.131967 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:49.131908 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 07:12:49.132143 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:12:49.131980 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert podName:0145d54b-4d41-49a0-b0e0-7099ddcd9095 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:05.131960625 +0000 UTC m=+74.332737636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4j2hm" (UID: "0145d54b-4d41-49a0-b0e0-7099ddcd9095") : secret "networking-console-plugin-cert" not found Jul 13 07:12:49.134413 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:49.134390 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2889d9ab-9b2e-4906-9864-11bca26adb6d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hbnvc\" (UID: \"2889d9ab-9b2e-4906-9864-11bca26adb6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:49.406815 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:49.406725 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" Jul 13 07:12:49.547496 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:49.547469 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc"] Jul 13 07:12:49.769648 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:49.769614 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" event={"ID":"2889d9ab-9b2e-4906-9864-11bca26adb6d","Type":"ContainerStarted","Data":"ef5c826fc796203576d12b916783b8c80aa25c06298606b93c1d8afa0e086dca"} Jul 13 07:12:51.777465 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:51.777429 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" event={"ID":"2889d9ab-9b2e-4906-9864-11bca26adb6d","Type":"ContainerStarted","Data":"6060f7e8490094b9f23c1431bb4c051b51f6b0db953bf7c1c3870175380c8c5c"} Jul 13 07:12:51.777853 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:51.777521 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" event={"ID":"2889d9ab-9b2e-4906-9864-11bca26adb6d","Type":"ContainerStarted","Data":"ab9220e375d8f2b2153093cee5cf0019ae186e914edfc88f2e312f23ec34f6ab"} Jul 13 07:12:51.794511 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:51.794452 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hbnvc" podStartSLOduration=17.00422587 podStartE2EDuration="18.794434667s" totalImagesPullingTime="1.790208797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:51.792693333 +0000 UTC m=+60.993470362" watchObservedRunningTime="2026-07-13 07:12:51.794434667 +0000 UTC m=+60.995211758" Jul 13 07:12:52.660606 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:52.660574 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8424l" Jul 13 07:12:57.005328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.005277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:57.007927 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.007903 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 07:12:57.018539 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.018509 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b278b201-14b9-4385-bd96-1217f541d675-metrics-certs\") pod \"network-metrics-daemon-k76c6\" (UID: \"b278b201-14b9-4385-bd96-1217f541d675\") " pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:57.106167 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.106123 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8s8\" (UniqueName: \"kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8\") pod \"network-check-target-9vmrv\" (UID: \"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe\") " pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:57.106167 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.106171 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:57.106442 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.106218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:57.108834 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.108808 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 07:12:57.108968 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.108908 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fc2478d-9e86-4364-8c04-4e7f20563244-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4bmz\" (UID: \"2fc2478d-9e86-4364-8c04-4e7f20563244\") " pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:57.109044 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.109026 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp8s8\" (UniqueName: \"kubernetes.io/projected/d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe-kube-api-access-wp8s8\") pod \"network-check-target-9vmrv\" (UID: \"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe\") " pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:57.119520 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.119487 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f25f49d9-494c-4db9-a4ab-4dc4b84dab74-original-pull-secret\") pod \"global-pull-secret-syncer-9qtcc\" (UID: \"f25f49d9-494c-4db9-a4ab-4dc4b84dab74\") " pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:57.148937 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.148893 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtcc" Jul 13 07:12:57.157117 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.157088 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5sc2t\"" Jul 13 07:12:57.165219 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.165191 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k76c6" Jul 13 07:12:57.236539 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.236035 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8g2nr\"" Jul 13 07:12:57.243689 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.243639 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k4bmz" Jul 13 07:12:57.293752 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.293716 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9qtcc"] Jul 13 07:12:57.297037 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:57.297011 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25f49d9_494c_4db9_a4ab_4dc4b84dab74.slice/crio-a936edea8af64e2799cf2029abac2ffe4f0c4b78e57bacc8a5418681bdb216e5 WatchSource:0}: Error finding container a936edea8af64e2799cf2029abac2ffe4f0c4b78e57bacc8a5418681bdb216e5: Status 404 returned error can't find the container with id a936edea8af64e2799cf2029abac2ffe4f0c4b78e57bacc8a5418681bdb216e5 Jul 13 07:12:57.316159 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.316120 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k76c6"] Jul 13 07:12:57.319834 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:57.319799 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb278b201_14b9_4385_bd96_1217f541d675.slice/crio-ddac032a83d0ecb5c70623bb5c87505ebaf3ffac5ed1ecc52c42b9eb9c3d2fef WatchSource:0}: Error finding container ddac032a83d0ecb5c70623bb5c87505ebaf3ffac5ed1ecc52c42b9eb9c3d2fef: Status 404 returned error can't find the container with id ddac032a83d0ecb5c70623bb5c87505ebaf3ffac5ed1ecc52c42b9eb9c3d2fef Jul 13 07:12:57.353403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.353372 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4492s\"" Jul 13 07:12:57.359553 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.359522 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:57.390461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.390427 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k4bmz"] Jul 13 07:12:57.394005 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:57.393973 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc2478d_9e86_4364_8c04_4e7f20563244.slice/crio-75563e492c1b51ef589a12943bdedfde8640a8ac95c362a604a2e4118ab68115 WatchSource:0}: Error finding container 75563e492c1b51ef589a12943bdedfde8640a8ac95c362a604a2e4118ab68115: Status 404 returned error can't find the container with id 75563e492c1b51ef589a12943bdedfde8640a8ac95c362a604a2e4118ab68115 Jul 13 07:12:57.494652 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.494495 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9vmrv"] Jul 13 07:12:57.497117 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:12:57.497095 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68c2d87_bf62_4bc7_8f50_8d2abfcc8fbe.slice/crio-54d1e0278ed918c72404873e4de5582f22151f795ab72c3ade35c2812e562037 WatchSource:0}: Error finding container 54d1e0278ed918c72404873e4de5582f22151f795ab72c3ade35c2812e562037: Status 404 returned error can't find the container with id 54d1e0278ed918c72404873e4de5582f22151f795ab72c3ade35c2812e562037 Jul 13 07:12:57.801197 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.801095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4bmz" event={"ID":"2fc2478d-9e86-4364-8c04-4e7f20563244","Type":"ContainerStarted","Data":"75563e492c1b51ef589a12943bdedfde8640a8ac95c362a604a2e4118ab68115"} Jul 13 07:12:57.803133 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.803092 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9vmrv" event={"ID":"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe","Type":"ContainerStarted","Data":"a3d104d7ba3caedfd345088a5df051ac7995e9360b9e475797bfe22e5a57aac3"} Jul 13 07:12:57.803287 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.803151 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9vmrv" event={"ID":"d68c2d87-bf62-4bc7-8f50-8d2abfcc8fbe","Type":"ContainerStarted","Data":"54d1e0278ed918c72404873e4de5582f22151f795ab72c3ade35c2812e562037"} Jul 13 07:12:57.803967 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.803913 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:12:57.805647 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.805605 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k76c6" event={"ID":"b278b201-14b9-4385-bd96-1217f541d675","Type":"ContainerStarted","Data":"ddac032a83d0ecb5c70623bb5c87505ebaf3ffac5ed1ecc52c42b9eb9c3d2fef"} Jul 13 07:12:57.807242 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.807217 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9qtcc" event={"ID":"f25f49d9-494c-4db9-a4ab-4dc4b84dab74","Type":"ContainerStarted","Data":"a936edea8af64e2799cf2029abac2ffe4f0c4b78e57bacc8a5418681bdb216e5"} Jul 13 07:12:57.820654 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:57.820588 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9vmrv" podStartSLOduration=66.820564458 podStartE2EDuration="1m6.820564458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:57.819501715 +0000 UTC m=+67.020278735" watchObservedRunningTime="2026-07-13 07:12:57.820564458 +0000 UTC m=+67.021341476" Jul 13 07:12:58.335697 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.335652 2561 scope.go:117] "RemoveContainer" containerID="e6d0942e89076abec34f38497fe58a5edd0a034cbb8cbe22baeb79207e309ccf" Jul 13 07:12:58.520602 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.520559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:58.520788 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.520629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:58.527205 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.527168 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52117e3a-733a-4799-939e-c8eeaa7f2c0d-metrics-tls\") pod \"dns-default-76h2t\" (UID: \"52117e3a-733a-4799-939e-c8eeaa7f2c0d\") " pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:58.528104 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.528053 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") pod \"image-registry-54fcc6ff69-krck2\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:58.729759 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.729564 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b6hvc\"" Jul 13 07:12:58.737403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.737350 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:58.747394 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.747362 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj5f5\"" Jul 13 07:12:58.756546 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.756226 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-76h2t" Jul 13 07:12:58.817025 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.816383 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:12:58.817025 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.816720 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-29tl4" event={"ID":"72183be4-cff0-4144-82bf-9f2eb4e4f463","Type":"ContainerStarted","Data":"565a5cfbacde5a064fabec24eb86a0941ea1d42534445bbde2ce05bcd35edb5a"} Jul 13 07:12:58.980680 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:58.980581 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54fcc6ff69-krck2"] Jul 13 07:12:59.012982 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.012947 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-76h2t"] Jul 13 07:12:59.832103 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.832035 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k76c6" event={"ID":"b278b201-14b9-4385-bd96-1217f541d675","Type":"ContainerStarted","Data":"73deb7e558b2ea8c1791f08a821aa62dd4da5bfc0268702fb204a03473d94f0f"} Jul 13 07:12:59.832916 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.832832 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k76c6" event={"ID":"b278b201-14b9-4385-bd96-1217f541d675","Type":"ContainerStarted","Data":"31bf448c461cac305ddd22548f2b5da24dbcf182f77d0fa9b54a9853c16a5e6f"} Jul 13 07:12:59.835118 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.834997 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-76h2t" event={"ID":"52117e3a-733a-4799-939e-c8eeaa7f2c0d","Type":"ContainerStarted","Data":"ea869e304a584b7d740ce0d1bfa332fb6fbe8faa2036766f0492c777b47f4d05"} Jul 13 07:12:59.839143 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.839098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" event={"ID":"6297f159-24b8-47e2-ba47-3a43876f9abf","Type":"ContainerStarted","Data":"66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497"} Jul 13 07:12:59.839340 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.839168 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" event={"ID":"6297f159-24b8-47e2-ba47-3a43876f9abf","Type":"ContainerStarted","Data":"5038cda529475be253424728bb63a665f392872c324c1167c64b158779070384"} Jul 13 07:12:59.839714 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.839687 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:12:59.839925 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.839900 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:59.847636 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.847587 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-29tl4" Jul 13 07:12:59.870566 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.870472 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k76c6" podStartSLOduration=67.03328399 podStartE2EDuration="1m8.870446641s" totalImagesPullingTime="1.837162651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:59.849368378 +0000 UTC m=+69.050145408" watchObservedRunningTime="2026-07-13 07:12:59.870446641 +0000 UTC m=+69.071223663" Jul 13 07:12:59.870782 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.870629 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" podStartSLOduration=67.870617575 podStartE2EDuration="1m7.870617575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:11:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:59.868585745 +0000 UTC m=+69.069362763" watchObservedRunningTime="2026-07-13 07:12:59.870617575 +0000 UTC m=+69.071394596" Jul 13 07:12:59.886100 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:12:59.885828 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-29tl4" podStartSLOduration=21.714283724 podStartE2EDuration="27.885802265s" totalImagesPullingTime="6.171518541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:59.884387301 +0000 UTC m=+69.085164330" watchObservedRunningTime="2026-07-13 07:12:59.885802265 +0000 UTC m=+69.086579282" Jul 13 07:13:04.861900 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:04.861865 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9qtcc" event={"ID":"f25f49d9-494c-4db9-a4ab-4dc4b84dab74","Type":"ContainerStarted","Data":"28c30e15b0a3a6fe1bb2c6661bff4ab6d5548de0ff2f575a1c29022a4552f097"} Jul 13 07:13:04.863787 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:04.863750 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-76h2t" event={"ID":"52117e3a-733a-4799-939e-c8eeaa7f2c0d","Type":"ContainerStarted","Data":"3f915a7930448aa44a364ec10bb0f40f9bba695e43846f0953a3bea7c6c47bab"} Jul 13 07:13:04.863979 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:04.863821 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-76h2t" Jul 13 07:13:04.863979 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:04.863848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-76h2t" event={"ID":"52117e3a-733a-4799-939e-c8eeaa7f2c0d","Type":"ContainerStarted","Data":"3fd427d81b1daad536a8a29fb077e7950bf3a4d37e14bd61f55ad872a009cf71"} Jul 13 07:13:04.865616 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:04.865586 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4bmz" event={"ID":"2fc2478d-9e86-4364-8c04-4e7f20563244","Type":"ContainerStarted","Data":"9778e2a020efe69d4796f690eec03504975382be48674f1af99303c1a9322829"} Jul 13 07:13:04.865723 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:04.865640 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4bmz" event={"ID":"2fc2478d-9e86-4364-8c04-4e7f20563244","Type":"ContainerStarted","Data":"9eba0c625382ba3a3fe3503021c62bffc289eeba3c1e2bec03acc22d01d64cfc"} Jul 13 07:13:04.878694 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:04.878633 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9qtcc" podStartSLOduration=66.140426809 podStartE2EDuration="1m12.878615953s" totalImagesPullingTime="6.738189144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:04.877040168 +0000 UTC m=+74.077817205" watchObservedRunningTime="2026-07-13 07:13:04.878615953 +0000 UTC m=+74.079392971" Jul 13 07:13:05.090362 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.090325 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:13:05.090572 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.090394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:13:05.090639 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.090585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:13:05.091316 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.091291 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-service-ca-bundle\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:13:05.093461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.093435 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ed22a84-eb0a-4525-b810-8635e11a5489-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkv55\" (UID: \"3ed22a84-eb0a-4525-b810-8635e11a5489\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:13:05.093590 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.093436 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f63c2209-ae62-4ed9-ae55-d0cf4a26b496-metrics-certs\") pod \"router-default-6bb4754dc8-h5xv7\" (UID: \"f63c2209-ae62-4ed9-ae55-d0cf4a26b496\") " pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:13:05.192120 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.192054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:13:05.195111 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.195078 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0145d54b-4d41-49a0-b0e0-7099ddcd9095-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4j2hm\" (UID: \"0145d54b-4d41-49a0-b0e0-7099ddcd9095\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:13:05.237776 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.237741 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pnhg7\"" Jul 13 07:13:05.245984 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.245945 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" Jul 13 07:13:05.285173 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.285123 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qttx5\"" Jul 13 07:13:05.292890 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.292809 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:13:05.325167 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.324883 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tlbtn\"" Jul 13 07:13:05.333605 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.332703 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" Jul 13 07:13:05.420408 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.420334 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-76h2t" podStartSLOduration=34.538844827 podStartE2EDuration="39.420308655s" totalImagesPullingTime="4.881463828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:04.892859721 +0000 UTC m=+74.093636739" watchObservedRunningTime="2026-07-13 07:13:05.420308655 +0000 UTC m=+74.621085673" Jul 13 07:13:05.421692 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.421661 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55"] Jul 13 07:13:05.431841 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:13:05.431790 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed22a84_eb0a_4525_b810_8635e11a5489.slice/crio-2f93ed9424919ea8ebdc9fc237177c07ba1615147580248293644ad4021b9878 WatchSource:0}: Error finding container 2f93ed9424919ea8ebdc9fc237177c07ba1615147580248293644ad4021b9878: Status 404 returned error can't find the container with id 2f93ed9424919ea8ebdc9fc237177c07ba1615147580248293644ad4021b9878 Jul 13 07:13:05.483882 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.483849 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bb4754dc8-h5xv7"] Jul 13 07:13:05.487174 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:13:05.487134 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63c2209_ae62_4ed9_ae55_d0cf4a26b496.slice/crio-728a1ae08fe2b40e8bddaf705e05c44c2d8b7a58d81b517419ef389237a1e354 WatchSource:0}: Error finding container 728a1ae08fe2b40e8bddaf705e05c44c2d8b7a58d81b517419ef389237a1e354: Status 404 returned error can't find the container with id 728a1ae08fe2b40e8bddaf705e05c44c2d8b7a58d81b517419ef389237a1e354 Jul 13 07:13:05.521380 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.521340 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4j2hm"] Jul 13 07:13:05.530448 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:13:05.530414 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0145d54b_4d41_49a0_b0e0_7099ddcd9095.slice/crio-523e5da06bffc3020a1ad8148af8a9644d8b7130cc90818b01209e1f3b7cc182 WatchSource:0}: Error finding container 523e5da06bffc3020a1ad8148af8a9644d8b7130cc90818b01209e1f3b7cc182: Status 404 returned error can't find the container with id 523e5da06bffc3020a1ad8148af8a9644d8b7130cc90818b01209e1f3b7cc182 Jul 13 07:13:05.872160 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.872115 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" event={"ID":"0145d54b-4d41-49a0-b0e0-7099ddcd9095","Type":"ContainerStarted","Data":"523e5da06bffc3020a1ad8148af8a9644d8b7130cc90818b01209e1f3b7cc182"} Jul 13 07:13:05.873702 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.873667 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" event={"ID":"3ed22a84-eb0a-4525-b810-8635e11a5489","Type":"ContainerStarted","Data":"2f93ed9424919ea8ebdc9fc237177c07ba1615147580248293644ad4021b9878"} Jul 13 07:13:05.875574 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.875538 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" event={"ID":"f63c2209-ae62-4ed9-ae55-d0cf4a26b496","Type":"ContainerStarted","Data":"0d39f90effd5e49e55e205ec0835336a6404fd92337a05e4363d1c585a674d16"} Jul 13 07:13:05.875773 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.875599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" event={"ID":"f63c2209-ae62-4ed9-ae55-d0cf4a26b496","Type":"ContainerStarted","Data":"728a1ae08fe2b40e8bddaf705e05c44c2d8b7a58d81b517419ef389237a1e354"} Jul 13 07:13:05.895397 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:05.894979 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" podStartSLOduration=32.894961197 podStartE2EDuration="32.894961197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:05.894251908 +0000 UTC m=+75.095028988" watchObservedRunningTime="2026-07-13 07:13:05.894961197 +0000 UTC m=+75.095738247" Jul 13 07:13:06.293449 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:06.293401 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:13:06.296937 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:06.296900 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:13:06.879897 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:06.879857 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:13:06.881545 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:06.881521 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bb4754dc8-h5xv7" Jul 13 07:13:08.125435 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.125397 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf"] Jul 13 07:13:08.149323 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.149288 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.152117 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.152076 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 07:13:08.152313 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.152149 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 07:13:08.153606 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.153358 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 13 07:13:08.153606 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.153497 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 07:13:08.154927 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.154899 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf"] Jul 13 07:13:08.222928 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.222895 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-bft64"] Jul 13 07:13:08.243942 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.243898 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-bft64"] Jul 13 07:13:08.244151 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.244028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-bft64" Jul 13 07:13:08.246477 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.246453 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-28xf5\"" Jul 13 07:13:08.246636 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.246614 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 07:13:08.246736 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.246722 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 07:13:08.319730 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.319676 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsh9m\" (UniqueName: \"kubernetes.io/projected/1f6a3416-fe89-4876-bbce-e7406d7eb509-kube-api-access-gsh9m\") pod \"klusterlet-addon-workmgr-9f7fd6b-jk6tf\" (UID: \"1f6a3416-fe89-4876-bbce-e7406d7eb509\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.319924 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.319748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1f6a3416-fe89-4876-bbce-e7406d7eb509-klusterlet-config\") pod \"klusterlet-addon-workmgr-9f7fd6b-jk6tf\" (UID: \"1f6a3416-fe89-4876-bbce-e7406d7eb509\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.319924 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.319772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f6a3416-fe89-4876-bbce-e7406d7eb509-tmp\") pod \"klusterlet-addon-workmgr-9f7fd6b-jk6tf\" (UID: \"1f6a3416-fe89-4876-bbce-e7406d7eb509\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.421048 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.420946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1f6a3416-fe89-4876-bbce-e7406d7eb509-klusterlet-config\") pod \"klusterlet-addon-workmgr-9f7fd6b-jk6tf\" (UID: \"1f6a3416-fe89-4876-bbce-e7406d7eb509\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.421048 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.421008 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f6a3416-fe89-4876-bbce-e7406d7eb509-tmp\") pod \"klusterlet-addon-workmgr-9f7fd6b-jk6tf\" (UID: \"1f6a3416-fe89-4876-bbce-e7406d7eb509\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.421288 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.421136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsh9m\" (UniqueName: \"kubernetes.io/projected/1f6a3416-fe89-4876-bbce-e7406d7eb509-kube-api-access-gsh9m\") pod \"klusterlet-addon-workmgr-9f7fd6b-jk6tf\" (UID: \"1f6a3416-fe89-4876-bbce-e7406d7eb509\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.421288 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.421191 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdbgq\" (UniqueName: \"kubernetes.io/projected/8c4c8cd3-1761-4ec9-bfd3-7fcf606b91d3-kube-api-access-wdbgq\") pod \"downloads-68c9cbb497-bft64\" (UID: \"8c4c8cd3-1761-4ec9-bfd3-7fcf606b91d3\") " pod="openshift-console/downloads-68c9cbb497-bft64" Jul 13 07:13:08.421489 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.421467 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f6a3416-fe89-4876-bbce-e7406d7eb509-tmp\") pod \"klusterlet-addon-workmgr-9f7fd6b-jk6tf\" (UID: \"1f6a3416-fe89-4876-bbce-e7406d7eb509\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.424560 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.424524 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1f6a3416-fe89-4876-bbce-e7406d7eb509-klusterlet-config\") pod \"klusterlet-addon-workmgr-9f7fd6b-jk6tf\" (UID: \"1f6a3416-fe89-4876-bbce-e7406d7eb509\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.434110 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.433999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsh9m\" (UniqueName: \"kubernetes.io/projected/1f6a3416-fe89-4876-bbce-e7406d7eb509-kube-api-access-gsh9m\") pod \"klusterlet-addon-workmgr-9f7fd6b-jk6tf\" (UID: \"1f6a3416-fe89-4876-bbce-e7406d7eb509\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.462485 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.462443 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:08.521888 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.521852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdbgq\" (UniqueName: \"kubernetes.io/projected/8c4c8cd3-1761-4ec9-bfd3-7fcf606b91d3-kube-api-access-wdbgq\") pod \"downloads-68c9cbb497-bft64\" (UID: \"8c4c8cd3-1761-4ec9-bfd3-7fcf606b91d3\") " pod="openshift-console/downloads-68c9cbb497-bft64" Jul 13 07:13:08.535625 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.535590 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdbgq\" (UniqueName: \"kubernetes.io/projected/8c4c8cd3-1761-4ec9-bfd3-7fcf606b91d3-kube-api-access-wdbgq\") pod \"downloads-68c9cbb497-bft64\" (UID: \"8c4c8cd3-1761-4ec9-bfd3-7fcf606b91d3\") " pod="openshift-console/downloads-68c9cbb497-bft64" Jul 13 07:13:08.555239 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.555195 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-bft64" Jul 13 07:13:08.644376 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.644342 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-94f47d6dc-m6znh"] Jul 13 07:13:08.676663 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.676569 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-94f47d6dc-m6znh"] Jul 13 07:13:08.676821 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.676688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.679494 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.679469 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 07:13:08.679813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.679784 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 07:13:08.679938 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.679784 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gb2r6\"" Jul 13 07:13:08.679938 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.679792 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 07:13:08.679938 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.679844 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 07:13:08.680152 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.680136 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 07:13:08.825113 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.825048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-config\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.825304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.825127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-serving-cert\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.825304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.825203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-service-ca\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.825304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.825245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-oauth-serving-cert\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.825304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.825284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-oauth-config\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.825455 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.825310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s2f2\" (UniqueName: \"kubernetes.io/projected/00d91c3c-23f0-4717-bebf-0ee7b49527dc-kube-api-access-8s2f2\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.926075 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.926020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-serving-cert\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.926222 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.926111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-service-ca\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.926222 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.926149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-oauth-serving-cert\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.926222 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.926199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-oauth-config\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.926371 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.926238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s2f2\" (UniqueName: \"kubernetes.io/projected/00d91c3c-23f0-4717-bebf-0ee7b49527dc-kube-api-access-8s2f2\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.926371 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.926271 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-config\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.927029 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.926960 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-config\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.927029 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.926959 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-service-ca\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.927176 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.927156 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-oauth-serving-cert\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.928776 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.928758 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-oauth-config\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.928834 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.928763 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-serving-cert\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.934716 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.934688 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s2f2\" (UniqueName: \"kubernetes.io/projected/00d91c3c-23f0-4717-bebf-0ee7b49527dc-kube-api-access-8s2f2\") pod \"console-94f47d6dc-m6znh\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:08.987515 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:08.987468 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:09.364558 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.364470 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-bft64"] Jul 13 07:13:09.369776 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:13:09.369747 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4c8cd3_1761_4ec9_bfd3_7fcf606b91d3.slice/crio-bd98a026f3dd5fde4c621a19961e04507b62544f99cc943879ec9305fca909e1 WatchSource:0}: Error finding container bd98a026f3dd5fde4c621a19961e04507b62544f99cc943879ec9305fca909e1: Status 404 returned error can't find the container with id bd98a026f3dd5fde4c621a19961e04507b62544f99cc943879ec9305fca909e1 Jul 13 07:13:09.382987 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.382950 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf"] Jul 13 07:13:09.386910 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.386844 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-94f47d6dc-m6znh"] Jul 13 07:13:09.387453 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:13:09.387424 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6a3416_fe89_4876_bbce_e7406d7eb509.slice/crio-c36652a89f57c517448947c5bc222ade8272f92e22912ae2478f1747c9ca1e1e WatchSource:0}: Error finding container c36652a89f57c517448947c5bc222ade8272f92e22912ae2478f1747c9ca1e1e: Status 404 returned error can't find the container with id c36652a89f57c517448947c5bc222ade8272f92e22912ae2478f1747c9ca1e1e Jul 13 07:13:09.392219 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:13:09.392181 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d91c3c_23f0_4717_bebf_0ee7b49527dc.slice/crio-937405fa0a54c5683eaaae3fb3305b9e09c1e350a6248b284de3c5d3e132ef1a WatchSource:0}: Error finding container 937405fa0a54c5683eaaae3fb3305b9e09c1e350a6248b284de3c5d3e132ef1a: Status 404 returned error can't find the container with id 937405fa0a54c5683eaaae3fb3305b9e09c1e350a6248b284de3c5d3e132ef1a Jul 13 07:13:09.893912 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.893872 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" event={"ID":"1f6a3416-fe89-4876-bbce-e7406d7eb509","Type":"ContainerStarted","Data":"c36652a89f57c517448947c5bc222ade8272f92e22912ae2478f1747c9ca1e1e"} Jul 13 07:13:09.895771 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.895734 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" event={"ID":"0145d54b-4d41-49a0-b0e0-7099ddcd9095","Type":"ContainerStarted","Data":"94240b1c9e66f8cdde480831512612e82cee004f50606e3c9f2c27f6439a0e86"} Jul 13 07:13:09.897001 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.896968 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-bft64" event={"ID":"8c4c8cd3-1761-4ec9-bfd3-7fcf606b91d3","Type":"ContainerStarted","Data":"bd98a026f3dd5fde4c621a19961e04507b62544f99cc943879ec9305fca909e1"} Jul 13 07:13:09.899150 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.899118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4bmz" event={"ID":"2fc2478d-9e86-4364-8c04-4e7f20563244","Type":"ContainerStarted","Data":"ae1b9fe168142b53e8234b8a6ededfde66851168150fb0020aefebb3941de185"} Jul 13 07:13:09.900438 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.900411 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94f47d6dc-m6znh" event={"ID":"00d91c3c-23f0-4717-bebf-0ee7b49527dc","Type":"ContainerStarted","Data":"937405fa0a54c5683eaaae3fb3305b9e09c1e350a6248b284de3c5d3e132ef1a"} Jul 13 07:13:09.907384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.907348 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" event={"ID":"3ed22a84-eb0a-4525-b810-8635e11a5489","Type":"ContainerStarted","Data":"48cd2b35b28636ca27d9ccb426f5cfc3436bcb21bdfb4703f2eb20cae6a05657"} Jul 13 07:13:09.918218 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.918164 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-4j2hm" podStartSLOduration=33.269888063 podStartE2EDuration="36.918147176s" totalImagesPullingTime="3.648259113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:09.917202837 +0000 UTC m=+79.117979877" watchObservedRunningTime="2026-07-13 07:13:09.918147176 +0000 UTC m=+79.118924184" Jul 13 07:13:09.932569 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.932496 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkv55" podStartSLOduration=33.18422282 podStartE2EDuration="36.932475337s" totalImagesPullingTime="3.748252517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:09.931767991 +0000 UTC m=+79.132545009" watchObservedRunningTime="2026-07-13 07:13:09.932475337 +0000 UTC m=+79.133252354" Jul 13 07:13:09.961029 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:09.960957 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k4bmz" podStartSLOduration=17.323323545 podStartE2EDuration="28.960928363s" totalImagesPullingTime="11.637604818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:09.959928955 +0000 UTC m=+79.160706009" watchObservedRunningTime="2026-07-13 07:13:09.960928363 +0000 UTC m=+79.161705385" Jul 13 07:13:14.878589 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:14.878462 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-76h2t" Jul 13 07:13:15.941807 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:15.941764 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" event={"ID":"1f6a3416-fe89-4876-bbce-e7406d7eb509","Type":"ContainerStarted","Data":"8495185e7d495d000a14e2c99651625afe4459d13dcc35c85ccb8d8efbf5ddcd"} Jul 13 07:13:15.942306 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:15.942025 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:15.944013 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:15.943977 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94f47d6dc-m6znh" event={"ID":"00d91c3c-23f0-4717-bebf-0ee7b49527dc","Type":"ContainerStarted","Data":"9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e"} Jul 13 07:13:15.944203 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:15.944089 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" Jul 13 07:13:15.957745 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:15.957689 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9f7fd6b-jk6tf" podStartSLOduration=2.325864024 podStartE2EDuration="7.957670231s" totalImagesPullingTime="5.631806207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:15.956523343 +0000 UTC m=+85.157300360" watchObservedRunningTime="2026-07-13 07:13:15.957670231 +0000 UTC m=+85.158447291" Jul 13 07:13:15.972157 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:15.972098 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-94f47d6dc-m6znh" podStartSLOduration=2.360758568 podStartE2EDuration="7.972082006s" totalImagesPullingTime="5.611323438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:15.971967437 +0000 UTC m=+85.172744454" watchObservedRunningTime="2026-07-13 07:13:15.972082006 +0000 UTC m=+85.172859019" Jul 13 07:13:18.988030 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:18.987985 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:18.988481 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:18.988127 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:18.994085 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:18.994031 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:19.966758 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:19.966725 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:21.852816 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:21.852788 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:13:22.425163 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.425119 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2qldd"] Jul 13 07:13:22.432229 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.432191 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.435181 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.435152 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 07:13:22.435181 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.435165 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 07:13:22.435384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.435231 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 07:13:22.436173 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.436151 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ddsqx\"" Jul 13 07:13:22.436423 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.436405 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 07:13:22.532048 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.532010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-textfile\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.532048 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.532055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-456xq\" (UniqueName: \"kubernetes.io/projected/d06a3d00-f8b0-4d77-9518-50eba8c992d6-kube-api-access-456xq\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.532327 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.532104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.532327 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.532131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.532327 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.532209 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-wtmp\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.532327 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.532295 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d06a3d00-f8b0-4d77-9518-50eba8c992d6-root\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.532527 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.532349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06a3d00-f8b0-4d77-9518-50eba8c992d6-metrics-client-ca\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.532527 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.532379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-tls\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.532527 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.532445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d06a3d00-f8b0-4d77-9518-50eba8c992d6-sys\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.633582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.633543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06a3d00-f8b0-4d77-9518-50eba8c992d6-metrics-client-ca\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.633582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.633585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-tls\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.633843 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.633613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d06a3d00-f8b0-4d77-9518-50eba8c992d6-sys\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.633843 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.633680 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d06a3d00-f8b0-4d77-9518-50eba8c992d6-sys\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.633843 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:13:22.633739 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 07:13:22.633843 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.633800 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-textfile\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.633843 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:13:22.633834 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-tls podName:d06a3d00-f8b0-4d77-9518-50eba8c992d6 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:23.133809195 +0000 UTC m=+92.334586193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-tls") pod "node-exporter-2qldd" (UID: "d06a3d00-f8b0-4d77-9518-50eba8c992d6") : secret "node-exporter-tls" not found Jul 13 07:13:22.634155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.633873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-456xq\" (UniqueName: \"kubernetes.io/projected/d06a3d00-f8b0-4d77-9518-50eba8c992d6-kube-api-access-456xq\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.634155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.633910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.634155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.633943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.634155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.633987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-wtmp\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.634155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.634046 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d06a3d00-f8b0-4d77-9518-50eba8c992d6-root\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.634155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.634116 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-textfile\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.634459 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.634173 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d06a3d00-f8b0-4d77-9518-50eba8c992d6-root\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.634459 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.634294 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06a3d00-f8b0-4d77-9518-50eba8c992d6-metrics-client-ca\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.634459 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.634447 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-wtmp\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.634661 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.634640 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.636962 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.636933 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:22.647606 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:22.647572 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-456xq\" (UniqueName: \"kubernetes.io/projected/d06a3d00-f8b0-4d77-9518-50eba8c992d6-kube-api-access-456xq\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:23.137485 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:23.137446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-tls\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:23.140494 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:23.140457 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d06a3d00-f8b0-4d77-9518-50eba8c992d6-node-exporter-tls\") pod \"node-exporter-2qldd\" (UID: \"d06a3d00-f8b0-4d77-9518-50eba8c992d6\") " pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:23.343803 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:23.343764 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2qldd" Jul 13 07:13:25.474945 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:25.474903 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-94f47d6dc-m6znh"] Jul 13 07:13:29.369232 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:13:29.369194 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06a3d00_f8b0_4d77_9518_50eba8c992d6.slice/crio-8743024ef631708480164fad267f69037f188a6351dbfbfd0beb26ab352681cc WatchSource:0}: Error finding container 8743024ef631708480164fad267f69037f188a6351dbfbfd0beb26ab352681cc: Status 404 returned error can't find the container with id 8743024ef631708480164fad267f69037f188a6351dbfbfd0beb26ab352681cc Jul 13 07:13:29.842295 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:29.842265 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9vmrv" Jul 13 07:13:29.997216 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:29.997177 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54fcc6ff69-krck2"] Jul 13 07:13:30.014624 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.014526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qldd" event={"ID":"d06a3d00-f8b0-4d77-9518-50eba8c992d6","Type":"ContainerStarted","Data":"8743024ef631708480164fad267f69037f188a6351dbfbfd0beb26ab352681cc"} Jul 13 07:13:30.016554 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.016523 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-bft64" event={"ID":"8c4c8cd3-1761-4ec9-bfd3-7fcf606b91d3","Type":"ContainerStarted","Data":"88f55ce6b8c6a2d729b8162392bd40d46b970ca09532440fa66d31db2830fec5"} Jul 13 07:13:30.017336 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.017302 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-bft64" Jul 13 07:13:30.018788 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.018760 2561 patch_prober.go:28] interesting pod/downloads-68c9cbb497-bft64 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.21:8080/\": dial tcp 10.132.0.21:8080: connect: connection refused" start-of-body= Jul 13 07:13:30.018986 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.018816 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-bft64" podUID="8c4c8cd3-1761-4ec9-bfd3-7fcf606b91d3" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.21:8080/\": dial tcp 10.132.0.21:8080: connect: connection refused" Jul 13 07:13:30.036039 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.035984 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-bft64" podStartSLOduration=1.647613378 podStartE2EDuration="22.035964624s" totalImagesPullingTime="20.388351246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:30.035252212 +0000 UTC m=+99.236029254" watchObservedRunningTime="2026-07-13 07:13:30.035964624 +0000 UTC m=+99.236741641" Jul 13 07:13:30.856299 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.856252 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bf495694b-bsnjd"] Jul 13 07:13:30.872356 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.872311 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf495694b-bsnjd"] Jul 13 07:13:30.872534 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.872467 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:30.883305 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.883277 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 07:13:30.905967 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.905919 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-console-config\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:30.905967 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.905971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-serving-cert\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:30.906252 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.905995 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5z2r\" (UniqueName: \"kubernetes.io/projected/5a8051ca-b6c5-4728-8725-cef43c73988e-kube-api-access-b5z2r\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:30.906252 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.906028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-service-ca\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:30.906252 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.906081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-oauth-config\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:30.906252 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.906123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-trusted-ca-bundle\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:30.906252 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:30.906190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-oauth-serving-cert\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.007114 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.007043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-console-config\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.007317 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.007141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-serving-cert\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.007317 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.007166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5z2r\" (UniqueName: \"kubernetes.io/projected/5a8051ca-b6c5-4728-8725-cef43c73988e-kube-api-access-b5z2r\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.007317 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.007203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-service-ca\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.007317 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.007237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-oauth-config\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.007317 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.007272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-trusted-ca-bundle\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.007317 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.007307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-oauth-serving-cert\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.008087 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.008044 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-oauth-serving-cert\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.008740 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.008715 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-console-config\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.008903 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.008830 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-service-ca\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.009292 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.009257 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-trusted-ca-bundle\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.010672 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.010649 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-serving-cert\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.011053 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.011033 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-oauth-config\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.016452 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.016424 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5z2r\" (UniqueName: \"kubernetes.io/projected/5a8051ca-b6c5-4728-8725-cef43c73988e-kube-api-access-b5z2r\") pod \"console-bf495694b-bsnjd\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.023690 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.023604 2561 generic.go:356] "Generic (PLEG): container finished" podID="d06a3d00-f8b0-4d77-9518-50eba8c992d6" containerID="61f843e6a9651ff64d0939de36aa14615b4c48d9f9627bb1ad750e96fa07e96d" exitCode=0 Jul 13 07:13:31.023851 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.023701 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qldd" event={"ID":"d06a3d00-f8b0-4d77-9518-50eba8c992d6","Type":"ContainerDied","Data":"61f843e6a9651ff64d0939de36aa14615b4c48d9f9627bb1ad750e96fa07e96d"} Jul 13 07:13:31.033720 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.033693 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-bft64" Jul 13 07:13:31.185158 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.185116 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:31.407383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:31.407346 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf495694b-bsnjd"] Jul 13 07:13:31.420837 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:13:31.420788 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8051ca_b6c5_4728_8725_cef43c73988e.slice/crio-fe0d0c0764203b245cf61f3ac33fa7bc8c5b0eeeae663e2699d62720e746504c WatchSource:0}: Error finding container fe0d0c0764203b245cf61f3ac33fa7bc8c5b0eeeae663e2699d62720e746504c: Status 404 returned error can't find the container with id fe0d0c0764203b245cf61f3ac33fa7bc8c5b0eeeae663e2699d62720e746504c Jul 13 07:13:32.031258 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:32.031211 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qldd" event={"ID":"d06a3d00-f8b0-4d77-9518-50eba8c992d6","Type":"ContainerStarted","Data":"81f3e8bf20dc92a16675ddd9fe2bb2994aa1f07eae4fc739f91b1f162501d88d"} Jul 13 07:13:32.031842 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:32.031287 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qldd" event={"ID":"d06a3d00-f8b0-4d77-9518-50eba8c992d6","Type":"ContainerStarted","Data":"6b8aadd9793460d875425e146020e4908c57f4b17392ca2e9ddd7415969baf05"} Jul 13 07:13:32.033326 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:32.033289 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf495694b-bsnjd" event={"ID":"5a8051ca-b6c5-4728-8725-cef43c73988e","Type":"ContainerStarted","Data":"69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7"} Jul 13 07:13:32.033467 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:32.033357 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf495694b-bsnjd" event={"ID":"5a8051ca-b6c5-4728-8725-cef43c73988e","Type":"ContainerStarted","Data":"fe0d0c0764203b245cf61f3ac33fa7bc8c5b0eeeae663e2699d62720e746504c"} Jul 13 07:13:32.054489 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:32.054424 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2qldd" podStartSLOduration=8.788840834 podStartE2EDuration="10.0544017s" totalImagesPullingTime="1.132259637s" totalInitContainerRuntime="133.301229ms" isStatefulPod=true podCreationTimestamp="2026-07-13 07:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:32.052177158 +0000 UTC m=+101.252954179" watchObservedRunningTime="2026-07-13 07:13:32.0544017 +0000 UTC m=+101.255178718" Jul 13 07:13:32.072354 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:32.072267 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bf495694b-bsnjd" podStartSLOduration=2.072249052 podStartE2EDuration="2.072249052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:32.070033016 +0000 UTC m=+101.270810050" watchObservedRunningTime="2026-07-13 07:13:32.072249052 +0000 UTC m=+101.273026068" Jul 13 07:13:34.414088 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.414015 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf495694b-bsnjd"] Jul 13 07:13:34.442720 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.442675 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78d4c46dd8-jm2sr"] Jul 13 07:13:34.501516 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.501471 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d4c46dd8-jm2sr"] Jul 13 07:13:34.501711 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.501618 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.546119 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.546054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-oauth-config\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.546321 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.546138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-service-ca\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.546321 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.546162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-serving-cert\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.546321 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.546259 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-config\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.546321 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.546294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-trusted-ca-bundle\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.546510 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.546336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-oauth-serving-cert\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.546510 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.546359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvshg\" (UniqueName: \"kubernetes.io/projected/47617cb2-a7dd-4dcd-953e-9321ee29634a-kube-api-access-kvshg\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.647118 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.647070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-oauth-config\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.647328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.647131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-service-ca\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.647328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.647161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-serving-cert\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.647328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.647260 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-config\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.647328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.647290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-trusted-ca-bundle\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.647548 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.647338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-oauth-serving-cert\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.647548 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.647360 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvshg\" (UniqueName: \"kubernetes.io/projected/47617cb2-a7dd-4dcd-953e-9321ee29634a-kube-api-access-kvshg\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.648238 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.648174 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-oauth-serving-cert\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.648371 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.648271 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-trusted-ca-bundle\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.648945 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.648899 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-config\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.649482 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.649454 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-service-ca\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.650331 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.650283 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-serving-cert\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.650430 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.650409 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-oauth-config\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.656344 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.656310 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvshg\" (UniqueName: \"kubernetes.io/projected/47617cb2-a7dd-4dcd-953e-9321ee29634a-kube-api-access-kvshg\") pod \"console-78d4c46dd8-jm2sr\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:34.814337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:34.814291 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:35.020709 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:35.020680 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d4c46dd8-jm2sr"] Jul 13 07:13:35.024179 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:13:35.024138 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47617cb2_a7dd_4dcd_953e_9321ee29634a.slice/crio-a8e393e79a97963816df9b1b13130db0b2af7acf00bec20bbd55f9d6db741e81 WatchSource:0}: Error finding container a8e393e79a97963816df9b1b13130db0b2af7acf00bec20bbd55f9d6db741e81: Status 404 returned error can't find the container with id a8e393e79a97963816df9b1b13130db0b2af7acf00bec20bbd55f9d6db741e81 Jul 13 07:13:35.048795 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:35.048751 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d4c46dd8-jm2sr" event={"ID":"47617cb2-a7dd-4dcd-953e-9321ee29634a","Type":"ContainerStarted","Data":"a8e393e79a97963816df9b1b13130db0b2af7acf00bec20bbd55f9d6db741e81"} Jul 13 07:13:36.055514 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:36.055472 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d4c46dd8-jm2sr" event={"ID":"47617cb2-a7dd-4dcd-953e-9321ee29634a","Type":"ContainerStarted","Data":"6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b"} Jul 13 07:13:36.073830 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:36.073753 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78d4c46dd8-jm2sr" podStartSLOduration=2.073730812 podStartE2EDuration="2.073730812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:36.072099075 +0000 UTC m=+105.272876090" watchObservedRunningTime="2026-07-13 07:13:36.073730812 +0000 UTC m=+105.274507927" Jul 13 07:13:41.185662 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:41.185610 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:44.814453 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:44.814407 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:44.815029 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:44.814476 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:44.821176 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:44.821144 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:45.098587 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:45.098493 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:13:50.502898 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.502843 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-94f47d6dc-m6znh" podUID="00d91c3c-23f0-4717-bebf-0ee7b49527dc" containerName="console" containerID="cri-o://9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e" gracePeriod=15 Jul 13 07:13:50.786868 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.786786 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:50.895133 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.895093 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-serving-cert\") pod \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " Jul 13 07:13:50.895133 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.895143 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-config\") pod \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " Jul 13 07:13:50.895384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.895176 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-service-ca\") pod \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " Jul 13 07:13:50.895384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.895205 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-oauth-serving-cert\") pod \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " Jul 13 07:13:50.895384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.895239 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s2f2\" (UniqueName: \"kubernetes.io/projected/00d91c3c-23f0-4717-bebf-0ee7b49527dc-kube-api-access-8s2f2\") pod \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " Jul 13 07:13:50.895384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.895274 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-oauth-config\") pod \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\" (UID: \"00d91c3c-23f0-4717-bebf-0ee7b49527dc\") " Jul 13 07:13:50.895683 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.895634 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-config" (OuterVolumeSpecName: "console-config") pod "00d91c3c-23f0-4717-bebf-0ee7b49527dc" (UID: "00d91c3c-23f0-4717-bebf-0ee7b49527dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:50.895683 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.895647 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-service-ca" (OuterVolumeSpecName: "service-ca") pod "00d91c3c-23f0-4717-bebf-0ee7b49527dc" (UID: "00d91c3c-23f0-4717-bebf-0ee7b49527dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:50.895683 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.895640 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "00d91c3c-23f0-4717-bebf-0ee7b49527dc" (UID: "00d91c3c-23f0-4717-bebf-0ee7b49527dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:50.897723 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.897695 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "00d91c3c-23f0-4717-bebf-0ee7b49527dc" (UID: "00d91c3c-23f0-4717-bebf-0ee7b49527dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:13:50.897832 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.897730 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "00d91c3c-23f0-4717-bebf-0ee7b49527dc" (UID: "00d91c3c-23f0-4717-bebf-0ee7b49527dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:13:50.897832 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.897763 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d91c3c-23f0-4717-bebf-0ee7b49527dc-kube-api-access-8s2f2" (OuterVolumeSpecName: "kube-api-access-8s2f2") pod "00d91c3c-23f0-4717-bebf-0ee7b49527dc" (UID: "00d91c3c-23f0-4717-bebf-0ee7b49527dc"). InnerVolumeSpecName "kube-api-access-8s2f2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:13:50.996349 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.996303 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s2f2\" (UniqueName: \"kubernetes.io/projected/00d91c3c-23f0-4717-bebf-0ee7b49527dc-kube-api-access-8s2f2\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:50.996349 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.996338 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-oauth-config\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:50.996349 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.996349 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-serving-cert\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:50.996349 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.996358 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-console-config\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:50.996349 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.996367 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-service-ca\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:50.996649 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:50.996376 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00d91c3c-23f0-4717-bebf-0ee7b49527dc-oauth-serving-cert\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:51.121157 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:51.121030 2561 generic.go:356] "Generic (PLEG): container finished" podID="00d91c3c-23f0-4717-bebf-0ee7b49527dc" containerID="9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e" exitCode=0 Jul 13 07:13:51.121157 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:51.121107 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94f47d6dc-m6znh" Jul 13 07:13:51.121157 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:51.121126 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94f47d6dc-m6znh" event={"ID":"00d91c3c-23f0-4717-bebf-0ee7b49527dc","Type":"ContainerDied","Data":"9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e"} Jul 13 07:13:51.121442 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:51.121186 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94f47d6dc-m6znh" event={"ID":"00d91c3c-23f0-4717-bebf-0ee7b49527dc","Type":"ContainerDied","Data":"937405fa0a54c5683eaaae3fb3305b9e09c1e350a6248b284de3c5d3e132ef1a"} Jul 13 07:13:51.121442 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:51.121208 2561 scope.go:117] "RemoveContainer" containerID="9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e" Jul 13 07:13:51.130955 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:51.130936 2561 scope.go:117] "RemoveContainer" containerID="9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e" Jul 13 07:13:51.131312 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:13:51.131288 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e\": container with ID starting with 9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e not found: ID does not exist" containerID="9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e" Jul 13 07:13:51.131378 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:51.131322 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e"} err="failed to get container status \"9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e\": rpc error: code = NotFound desc = could not find container \"9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e\": container with ID starting with 9bdfcb8d751c5cdf6959db0fc153f877897774762f87c17d70401a05b500df4e not found: ID does not exist" Jul 13 07:13:51.141826 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:51.141795 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-94f47d6dc-m6znh"] Jul 13 07:13:51.145468 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:51.145422 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-94f47d6dc-m6znh"] Jul 13 07:13:51.340260 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:51.340223 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00d91c3c-23f0-4717-bebf-0ee7b49527dc" path="/var/lib/kubelet/pods/00d91c3c-23f0-4717-bebf-0ee7b49527dc/volumes" Jul 13 07:13:55.029790 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.029740 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" podUID="6297f159-24b8-47e2-ba47-3a43876f9abf" containerName="registry" containerID="cri-o://66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497" gracePeriod=30 Jul 13 07:13:55.326238 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.326195 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:13:55.432311 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.432264 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-installation-pull-secrets\") pod \"6297f159-24b8-47e2-ba47-3a43876f9abf\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " Jul 13 07:13:55.432511 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.432358 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") pod \"6297f159-24b8-47e2-ba47-3a43876f9abf\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " Jul 13 07:13:55.432511 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.432389 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-bound-sa-token\") pod \"6297f159-24b8-47e2-ba47-3a43876f9abf\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " Jul 13 07:13:55.432511 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.432423 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-image-registry-private-configuration\") pod \"6297f159-24b8-47e2-ba47-3a43876f9abf\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " Jul 13 07:13:55.432511 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.432459 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6297f159-24b8-47e2-ba47-3a43876f9abf-ca-trust-extracted\") pod \"6297f159-24b8-47e2-ba47-3a43876f9abf\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " Jul 13 07:13:55.432511 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.432500 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-certificates\") pod \"6297f159-24b8-47e2-ba47-3a43876f9abf\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " Jul 13 07:13:55.432773 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.432547 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-trusted-ca\") pod \"6297f159-24b8-47e2-ba47-3a43876f9abf\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " Jul 13 07:13:55.432773 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.432578 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46z6q\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-kube-api-access-46z6q\") pod \"6297f159-24b8-47e2-ba47-3a43876f9abf\" (UID: \"6297f159-24b8-47e2-ba47-3a43876f9abf\") " Jul 13 07:13:55.433292 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.433256 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6297f159-24b8-47e2-ba47-3a43876f9abf" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:55.433709 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.433679 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6297f159-24b8-47e2-ba47-3a43876f9abf" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:55.435182 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.435130 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6297f159-24b8-47e2-ba47-3a43876f9abf" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:13:55.435291 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.435247 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6297f159-24b8-47e2-ba47-3a43876f9abf" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:13:55.435361 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.435299 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-kube-api-access-46z6q" (OuterVolumeSpecName: "kube-api-access-46z6q") pod "6297f159-24b8-47e2-ba47-3a43876f9abf" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf"). InnerVolumeSpecName "kube-api-access-46z6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:13:55.435417 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.435354 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6297f159-24b8-47e2-ba47-3a43876f9abf" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:13:55.435417 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.435393 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6297f159-24b8-47e2-ba47-3a43876f9abf" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:13:55.441778 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.441745 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6297f159-24b8-47e2-ba47-3a43876f9abf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6297f159-24b8-47e2-ba47-3a43876f9abf" (UID: "6297f159-24b8-47e2-ba47-3a43876f9abf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:13:55.533479 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.533433 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-trusted-ca\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:55.533479 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.533474 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46z6q\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-kube-api-access-46z6q\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:55.533479 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.533488 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-installation-pull-secrets\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:55.533749 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.533500 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-tls\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:55.533749 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.533512 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6297f159-24b8-47e2-ba47-3a43876f9abf-bound-sa-token\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:55.533749 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.533525 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6297f159-24b8-47e2-ba47-3a43876f9abf-image-registry-private-configuration\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:55.533749 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.533539 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6297f159-24b8-47e2-ba47-3a43876f9abf-ca-trust-extracted\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:55.533749 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:55.533551 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6297f159-24b8-47e2-ba47-3a43876f9abf-registry-certificates\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:56.141861 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.141826 2561 generic.go:356] "Generic (PLEG): container finished" podID="6297f159-24b8-47e2-ba47-3a43876f9abf" containerID="66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497" exitCode=0 Jul 13 07:13:56.142383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.141874 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" Jul 13 07:13:56.142383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.141909 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" event={"ID":"6297f159-24b8-47e2-ba47-3a43876f9abf","Type":"ContainerDied","Data":"66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497"} Jul 13 07:13:56.142383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.141971 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54fcc6ff69-krck2" event={"ID":"6297f159-24b8-47e2-ba47-3a43876f9abf","Type":"ContainerDied","Data":"5038cda529475be253424728bb63a665f392872c324c1167c64b158779070384"} Jul 13 07:13:56.142383 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.142002 2561 scope.go:117] "RemoveContainer" containerID="66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497" Jul 13 07:13:56.143663 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.143634 2561 generic.go:356] "Generic (PLEG): container finished" podID="f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7" containerID="4d00cba74ac76aa6763692e41715fee979f8a2b769c8ad3dfa3683970bc2fd69" exitCode=0 Jul 13 07:13:56.143767 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.143737 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" event={"ID":"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7","Type":"ContainerDied","Data":"4d00cba74ac76aa6763692e41715fee979f8a2b769c8ad3dfa3683970bc2fd69"} Jul 13 07:13:56.144122 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.144107 2561 scope.go:117] "RemoveContainer" containerID="4d00cba74ac76aa6763692e41715fee979f8a2b769c8ad3dfa3683970bc2fd69" Jul 13 07:13:56.153926 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.153906 2561 scope.go:117] "RemoveContainer" containerID="66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497" Jul 13 07:13:56.154258 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:13:56.154237 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497\": container with ID starting with 66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497 not found: ID does not exist" containerID="66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497" Jul 13 07:13:56.154321 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.154268 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497"} err="failed to get container status \"66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497\": rpc error: code = NotFound desc = could not find container \"66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497\": container with ID starting with 66bd6274c719961710492d669b7c3aa49b8e794528dcdcc95106fce47fb17497 not found: ID does not exist" Jul 13 07:13:56.177937 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.177888 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54fcc6ff69-krck2"] Jul 13 07:13:56.182620 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:56.182577 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54fcc6ff69-krck2"] Jul 13 07:13:57.150959 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:57.150920 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wj68z" event={"ID":"f1d546c3-0d9f-42b2-8206-7a4f6e0b7bf7","Type":"ContainerStarted","Data":"75d8bf17796e745539ffbdccac2a7b62bf5cb685f393c4779a53e51c3798d45d"} Jul 13 07:13:57.340733 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:57.340693 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6297f159-24b8-47e2-ba47-3a43876f9abf" path="/var/lib/kubelet/pods/6297f159-24b8-47e2-ba47-3a43876f9abf/volumes" Jul 13 07:13:59.441933 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.441882 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bf495694b-bsnjd" podUID="5a8051ca-b6c5-4728-8725-cef43c73988e" containerName="console" containerID="cri-o://69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7" gracePeriod=15 Jul 13 07:13:59.727767 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.727718 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:13:59.881603 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.881568 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-oauth-serving-cert\") pod \"5a8051ca-b6c5-4728-8725-cef43c73988e\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " Jul 13 07:13:59.881832 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.881626 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-oauth-config\") pod \"5a8051ca-b6c5-4728-8725-cef43c73988e\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " Jul 13 07:13:59.881832 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.881700 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5z2r\" (UniqueName: \"kubernetes.io/projected/5a8051ca-b6c5-4728-8725-cef43c73988e-kube-api-access-b5z2r\") pod \"5a8051ca-b6c5-4728-8725-cef43c73988e\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " Jul 13 07:13:59.881832 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.881742 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-console-config\") pod \"5a8051ca-b6c5-4728-8725-cef43c73988e\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " Jul 13 07:13:59.881832 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.881777 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-service-ca\") pod \"5a8051ca-b6c5-4728-8725-cef43c73988e\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " Jul 13 07:13:59.881832 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.881799 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-trusted-ca-bundle\") pod \"5a8051ca-b6c5-4728-8725-cef43c73988e\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " Jul 13 07:13:59.882256 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.881854 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-serving-cert\") pod \"5a8051ca-b6c5-4728-8725-cef43c73988e\" (UID: \"5a8051ca-b6c5-4728-8725-cef43c73988e\") " Jul 13 07:13:59.882256 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.882016 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a8051ca-b6c5-4728-8725-cef43c73988e" (UID: "5a8051ca-b6c5-4728-8725-cef43c73988e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:59.882390 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.882274 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-oauth-serving-cert\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:59.882524 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.882492 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-console-config" (OuterVolumeSpecName: "console-config") pod "5a8051ca-b6c5-4728-8725-cef43c73988e" (UID: "5a8051ca-b6c5-4728-8725-cef43c73988e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:59.882524 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.882496 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a8051ca-b6c5-4728-8725-cef43c73988e" (UID: "5a8051ca-b6c5-4728-8725-cef43c73988e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:59.882940 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.882820 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a8051ca-b6c5-4728-8725-cef43c73988e" (UID: "5a8051ca-b6c5-4728-8725-cef43c73988e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:59.884446 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.884419 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a8051ca-b6c5-4728-8725-cef43c73988e" (UID: "5a8051ca-b6c5-4728-8725-cef43c73988e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:13:59.884586 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.884441 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a8051ca-b6c5-4728-8725-cef43c73988e" (UID: "5a8051ca-b6c5-4728-8725-cef43c73988e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:13:59.884672 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.884653 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a8051ca-b6c5-4728-8725-cef43c73988e-kube-api-access-b5z2r" (OuterVolumeSpecName: "kube-api-access-b5z2r") pod "5a8051ca-b6c5-4728-8725-cef43c73988e" (UID: "5a8051ca-b6c5-4728-8725-cef43c73988e"). InnerVolumeSpecName "kube-api-access-b5z2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:13:59.983355 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.983315 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-oauth-config\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:59.983355 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.983349 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5z2r\" (UniqueName: \"kubernetes.io/projected/5a8051ca-b6c5-4728-8725-cef43c73988e-kube-api-access-b5z2r\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:59.983355 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.983360 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-console-config\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:59.983612 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.983370 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-service-ca\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:59.983612 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.983379 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a8051ca-b6c5-4728-8725-cef43c73988e-trusted-ca-bundle\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:13:59.983612 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:13:59.983388 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a8051ca-b6c5-4728-8725-cef43c73988e-console-serving-cert\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:14:00.165167 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:00.165125 2561 generic.go:356] "Generic (PLEG): container finished" podID="5a8051ca-b6c5-4728-8725-cef43c73988e" containerID="69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7" exitCode=0 Jul 13 07:14:00.165342 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:00.165172 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf495694b-bsnjd" event={"ID":"5a8051ca-b6c5-4728-8725-cef43c73988e","Type":"ContainerDied","Data":"69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7"} Jul 13 07:14:00.165342 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:00.165180 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf495694b-bsnjd" Jul 13 07:14:00.165342 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:00.165225 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf495694b-bsnjd" event={"ID":"5a8051ca-b6c5-4728-8725-cef43c73988e","Type":"ContainerDied","Data":"fe0d0c0764203b245cf61f3ac33fa7bc8c5b0eeeae663e2699d62720e746504c"} Jul 13 07:14:00.165342 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:00.165248 2561 scope.go:117] "RemoveContainer" containerID="69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7" Jul 13 07:14:00.174241 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:00.174222 2561 scope.go:117] "RemoveContainer" containerID="69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7" Jul 13 07:14:00.174587 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:14:00.174561 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7\": container with ID starting with 69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7 not found: ID does not exist" containerID="69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7" Jul 13 07:14:00.174630 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:00.174601 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7"} err="failed to get container status \"69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7\": rpc error: code = NotFound desc = could not find container \"69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7\": container with ID starting with 69d3b7ee060fc92a46aefbb48813ee9d304e121973f9492dd4f13729f6e71bc7 not found: ID does not exist" Jul 13 07:14:00.186461 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:00.186424 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf495694b-bsnjd"] Jul 13 07:14:00.190537 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:00.190501 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bf495694b-bsnjd"] Jul 13 07:14:01.172002 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:01.171967 2561 generic.go:356] "Generic (PLEG): container finished" podID="2491c05e-614f-4f06-91e0-8397e6209aae" containerID="3c5274befb29fa0f1a2a2c47929874f2d91017f7f8ba1968d91bbd0fb814b212" exitCode=0 Jul 13 07:14:01.172407 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:01.172047 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" event={"ID":"2491c05e-614f-4f06-91e0-8397e6209aae","Type":"ContainerDied","Data":"3c5274befb29fa0f1a2a2c47929874f2d91017f7f8ba1968d91bbd0fb814b212"} Jul 13 07:14:01.172451 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:01.172429 2561 scope.go:117] "RemoveContainer" containerID="3c5274befb29fa0f1a2a2c47929874f2d91017f7f8ba1968d91bbd0fb814b212" Jul 13 07:14:01.340966 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:01.340929 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a8051ca-b6c5-4728-8725-cef43c73988e" path="/var/lib/kubelet/pods/5a8051ca-b6c5-4728-8725-cef43c73988e/volumes" Jul 13 07:14:02.177555 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:02.177517 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ths59" event={"ID":"2491c05e-614f-4f06-91e0-8397e6209aae","Type":"ContainerStarted","Data":"5620f3323f383bab7c44006635ef3b7f0f28a6d0011674a55dd63c2d0c5ad679"} Jul 13 07:14:11.216673 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:11.216633 2561 generic.go:356] "Generic (PLEG): container finished" podID="9452bd9c-8b2d-4890-ae49-63a71ff19332" containerID="65f96498f7166146fa1891f3a14cbbdd576324fdb81f0a02e8284da9e44bf203" exitCode=0 Jul 13 07:14:11.217142 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:11.216706 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" event={"ID":"9452bd9c-8b2d-4890-ae49-63a71ff19332","Type":"ContainerDied","Data":"65f96498f7166146fa1891f3a14cbbdd576324fdb81f0a02e8284da9e44bf203"} Jul 13 07:14:11.217142 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:11.217114 2561 scope.go:117] "RemoveContainer" containerID="65f96498f7166146fa1891f3a14cbbdd576324fdb81f0a02e8284da9e44bf203" Jul 13 07:14:12.222191 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:12.222153 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rxz9h" event={"ID":"9452bd9c-8b2d-4890-ae49-63a71ff19332","Type":"ContainerStarted","Data":"d69ab181819a7df9d3ff5d314fb857460c75166f1345d9c482ec4aa4da9db4f4"} Jul 13 07:14:55.334785 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.334747 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-799584c6cc-xqgsx"] Jul 13 07:14:55.335796 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.335769 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a8051ca-b6c5-4728-8725-cef43c73988e" containerName="console" Jul 13 07:14:55.335965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.335951 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a8051ca-b6c5-4728-8725-cef43c73988e" containerName="console" Jul 13 07:14:55.336108 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.336093 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d91c3c-23f0-4717-bebf-0ee7b49527dc" containerName="console" Jul 13 07:14:55.336216 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.336194 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d91c3c-23f0-4717-bebf-0ee7b49527dc" containerName="console" Jul 13 07:14:55.336341 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.336224 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6297f159-24b8-47e2-ba47-3a43876f9abf" containerName="registry" Jul 13 07:14:55.336341 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.336233 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6297f159-24b8-47e2-ba47-3a43876f9abf" containerName="registry" Jul 13 07:14:55.336341 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.336336 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d91c3c-23f0-4717-bebf-0ee7b49527dc" containerName="console" Jul 13 07:14:55.336500 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.336350 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6297f159-24b8-47e2-ba47-3a43876f9abf" containerName="registry" Jul 13 07:14:55.336500 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.336360 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a8051ca-b6c5-4728-8725-cef43c73988e" containerName="console" Jul 13 07:14:55.343825 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.343794 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.350886 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.350857 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-799584c6cc-xqgsx"] Jul 13 07:14:55.426328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.426278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-oauth-config\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.426328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.426327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfj2v\" (UniqueName: \"kubernetes.io/projected/4892081f-1c79-411b-957f-6693a5473f65-kube-api-access-kfj2v\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.426573 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.426345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-oauth-serving-cert\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.426573 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.426472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-trusted-ca-bundle\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.426644 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.426578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-serving-cert\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.426644 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.426615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-console-config\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.426644 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.426632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-service-ca\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.527649 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.527604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-serving-cert\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.527649 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.527656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-console-config\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.527930 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.527698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-service-ca\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.527930 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.527755 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-oauth-config\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.527930 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.527784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfj2v\" (UniqueName: \"kubernetes.io/projected/4892081f-1c79-411b-957f-6693a5473f65-kube-api-access-kfj2v\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.527930 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.527809 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-oauth-serving-cert\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.527930 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.527884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-trusted-ca-bundle\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.528636 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.528566 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-service-ca\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.528636 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.528579 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-oauth-serving-cert\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.528636 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.528581 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-console-config\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.528949 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.528813 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-trusted-ca-bundle\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.530515 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.530486 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-serving-cert\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.530601 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.530522 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-oauth-config\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.536569 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.536541 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfj2v\" (UniqueName: \"kubernetes.io/projected/4892081f-1c79-411b-957f-6693a5473f65-kube-api-access-kfj2v\") pod \"console-799584c6cc-xqgsx\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.658619 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.658522 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:14:55.796619 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:55.796582 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-799584c6cc-xqgsx"] Jul 13 07:14:55.800280 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:14:55.800248 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4892081f_1c79_411b_957f_6693a5473f65.slice/crio-aebf711f196affea9a807cee7fa499a7c68d7b967bbe22e750d09698f94a647f WatchSource:0}: Error finding container aebf711f196affea9a807cee7fa499a7c68d7b967bbe22e750d09698f94a647f: Status 404 returned error can't find the container with id aebf711f196affea9a807cee7fa499a7c68d7b967bbe22e750d09698f94a647f Jul 13 07:14:56.399814 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:56.399775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799584c6cc-xqgsx" event={"ID":"4892081f-1c79-411b-957f-6693a5473f65","Type":"ContainerStarted","Data":"0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951"} Jul 13 07:14:56.400364 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:56.399829 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799584c6cc-xqgsx" event={"ID":"4892081f-1c79-411b-957f-6693a5473f65","Type":"ContainerStarted","Data":"aebf711f196affea9a807cee7fa499a7c68d7b967bbe22e750d09698f94a647f"} Jul 13 07:14:56.418770 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:14:56.418715 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-799584c6cc-xqgsx" podStartSLOduration=1.4186960069999999 podStartE2EDuration="1.418696007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:14:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:14:56.417334229 +0000 UTC m=+185.618111250" watchObservedRunningTime="2026-07-13 07:14:56.418696007 +0000 UTC m=+185.619473024" Jul 13 07:15:05.659593 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:05.659554 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:15:05.660084 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:05.659623 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:15:05.664658 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:05.664630 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:15:06.445560 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:06.445529 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:15:06.491821 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:06.491779 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d4c46dd8-jm2sr"] Jul 13 07:15:31.519447 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.519407 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78d4c46dd8-jm2sr" podUID="47617cb2-a7dd-4dcd-953e-9321ee29634a" containerName="console" containerID="cri-o://6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b" gracePeriod=15 Jul 13 07:15:31.770916 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.770843 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:15:31.836348 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.836311 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-config\") pod \"47617cb2-a7dd-4dcd-953e-9321ee29634a\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " Jul 13 07:15:31.836530 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.836367 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-serving-cert\") pod \"47617cb2-a7dd-4dcd-953e-9321ee29634a\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " Jul 13 07:15:31.836530 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.836390 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-trusted-ca-bundle\") pod \"47617cb2-a7dd-4dcd-953e-9321ee29634a\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " Jul 13 07:15:31.836530 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.836418 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-oauth-config\") pod \"47617cb2-a7dd-4dcd-953e-9321ee29634a\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " Jul 13 07:15:31.836530 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.836435 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvshg\" (UniqueName: \"kubernetes.io/projected/47617cb2-a7dd-4dcd-953e-9321ee29634a-kube-api-access-kvshg\") pod \"47617cb2-a7dd-4dcd-953e-9321ee29634a\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " Jul 13 07:15:31.836530 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.836464 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-oauth-serving-cert\") pod \"47617cb2-a7dd-4dcd-953e-9321ee29634a\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " Jul 13 07:15:31.836530 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.836516 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-service-ca\") pod \"47617cb2-a7dd-4dcd-953e-9321ee29634a\" (UID: \"47617cb2-a7dd-4dcd-953e-9321ee29634a\") " Jul 13 07:15:31.836813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.836787 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-config" (OuterVolumeSpecName: "console-config") pod "47617cb2-a7dd-4dcd-953e-9321ee29634a" (UID: "47617cb2-a7dd-4dcd-953e-9321ee29634a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:15:31.836966 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.836939 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "47617cb2-a7dd-4dcd-953e-9321ee29634a" (UID: "47617cb2-a7dd-4dcd-953e-9321ee29634a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:15:31.837128 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.837053 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-service-ca" (OuterVolumeSpecName: "service-ca") pod "47617cb2-a7dd-4dcd-953e-9321ee29634a" (UID: "47617cb2-a7dd-4dcd-953e-9321ee29634a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:15:31.837128 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.837079 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "47617cb2-a7dd-4dcd-953e-9321ee29634a" (UID: "47617cb2-a7dd-4dcd-953e-9321ee29634a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:15:31.839021 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.838989 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "47617cb2-a7dd-4dcd-953e-9321ee29634a" (UID: "47617cb2-a7dd-4dcd-953e-9321ee29634a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:15:31.839142 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.839079 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47617cb2-a7dd-4dcd-953e-9321ee29634a-kube-api-access-kvshg" (OuterVolumeSpecName: "kube-api-access-kvshg") pod "47617cb2-a7dd-4dcd-953e-9321ee29634a" (UID: "47617cb2-a7dd-4dcd-953e-9321ee29634a"). InnerVolumeSpecName "kube-api-access-kvshg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:15:31.839185 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.839154 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "47617cb2-a7dd-4dcd-953e-9321ee29634a" (UID: "47617cb2-a7dd-4dcd-953e-9321ee29634a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:15:31.938116 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.938046 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-service-ca\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:15:31.938116 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.938109 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-config\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:15:31.938116 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.938118 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-serving-cert\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:15:31.938116 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.938128 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-trusted-ca-bundle\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:15:31.938397 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.938136 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47617cb2-a7dd-4dcd-953e-9321ee29634a-console-oauth-config\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:15:31.938397 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.938155 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvshg\" (UniqueName: \"kubernetes.io/projected/47617cb2-a7dd-4dcd-953e-9321ee29634a-kube-api-access-kvshg\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:15:31.938397 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:31.938164 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47617cb2-a7dd-4dcd-953e-9321ee29634a-oauth-serving-cert\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:15:32.547069 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:32.547035 2561 generic.go:356] "Generic (PLEG): container finished" podID="47617cb2-a7dd-4dcd-953e-9321ee29634a" containerID="6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b" exitCode=0 Jul 13 07:15:32.547516 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:32.547103 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d4c46dd8-jm2sr" Jul 13 07:15:32.547516 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:32.547124 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d4c46dd8-jm2sr" event={"ID":"47617cb2-a7dd-4dcd-953e-9321ee29634a","Type":"ContainerDied","Data":"6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b"} Jul 13 07:15:32.547516 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:32.547186 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d4c46dd8-jm2sr" event={"ID":"47617cb2-a7dd-4dcd-953e-9321ee29634a","Type":"ContainerDied","Data":"a8e393e79a97963816df9b1b13130db0b2af7acf00bec20bbd55f9d6db741e81"} Jul 13 07:15:32.547516 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:32.547218 2561 scope.go:117] "RemoveContainer" containerID="6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b" Jul 13 07:15:32.556729 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:32.556709 2561 scope.go:117] "RemoveContainer" containerID="6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b" Jul 13 07:15:32.557089 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:15:32.557048 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b\": container with ID starting with 6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b not found: ID does not exist" containerID="6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b" Jul 13 07:15:32.557152 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:32.557101 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b"} err="failed to get container status \"6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b\": rpc error: code = NotFound desc = could not find container \"6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b\": container with ID starting with 6cd6b882b67da3104ca87f0f56509ae3104f9e67ff9460954ae8194696c7948b not found: ID does not exist" Jul 13 07:15:32.567638 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:32.567605 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d4c46dd8-jm2sr"] Jul 13 07:15:32.571094 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:32.571046 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78d4c46dd8-jm2sr"] Jul 13 07:15:33.340450 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:15:33.340413 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47617cb2-a7dd-4dcd-953e-9321ee29634a" path="/var/lib/kubelet/pods/47617cb2-a7dd-4dcd-953e-9321ee29634a/volumes" Jul 13 07:16:28.791795 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.791700 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d"] Jul 13 07:16:28.792271 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.791992 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47617cb2-a7dd-4dcd-953e-9321ee29634a" containerName="console" Jul 13 07:16:28.792271 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.792003 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="47617cb2-a7dd-4dcd-953e-9321ee29634a" containerName="console" Jul 13 07:16:28.792271 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.792053 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="47617cb2-a7dd-4dcd-953e-9321ee29634a" containerName="console" Jul 13 07:16:28.794405 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.794385 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" Jul 13 07:16:28.797153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.797130 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:16:28.797391 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.797373 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 13 07:16:28.797486 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.797438 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rxmh7\"" Jul 13 07:16:28.809665 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.809638 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d"] Jul 13 07:16:28.980775 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.980735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjqgd\" (UniqueName: \"kubernetes.io/projected/56750fed-9157-46b8-9893-2f9f3098e23a-kube-api-access-wjqgd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfx6d\" (UID: \"56750fed-9157-46b8-9893-2f9f3098e23a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" Jul 13 07:16:28.980775 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:28.980778 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56750fed-9157-46b8-9893-2f9f3098e23a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfx6d\" (UID: \"56750fed-9157-46b8-9893-2f9f3098e23a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" Jul 13 07:16:29.081921 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:29.081821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjqgd\" (UniqueName: \"kubernetes.io/projected/56750fed-9157-46b8-9893-2f9f3098e23a-kube-api-access-wjqgd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfx6d\" (UID: \"56750fed-9157-46b8-9893-2f9f3098e23a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" Jul 13 07:16:29.081921 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:29.081876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56750fed-9157-46b8-9893-2f9f3098e23a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfx6d\" (UID: \"56750fed-9157-46b8-9893-2f9f3098e23a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" Jul 13 07:16:29.082283 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:29.082266 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56750fed-9157-46b8-9893-2f9f3098e23a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfx6d\" (UID: \"56750fed-9157-46b8-9893-2f9f3098e23a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" Jul 13 07:16:29.095323 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:29.095298 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjqgd\" (UniqueName: \"kubernetes.io/projected/56750fed-9157-46b8-9893-2f9f3098e23a-kube-api-access-wjqgd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfx6d\" (UID: \"56750fed-9157-46b8-9893-2f9f3098e23a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" Jul 13 07:16:29.104112 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:29.104076 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" Jul 13 07:16:29.252328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:29.252275 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d"] Jul 13 07:16:29.257214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:16:29.257182 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56750fed_9157_46b8_9893_2f9f3098e23a.slice/crio-db6d121c5a2dfb92358b720e546892d8308ed323fe6580866751db9c62ab0473 WatchSource:0}: Error finding container db6d121c5a2dfb92358b720e546892d8308ed323fe6580866751db9c62ab0473: Status 404 returned error can't find the container with id db6d121c5a2dfb92358b720e546892d8308ed323fe6580866751db9c62ab0473 Jul 13 07:16:29.765890 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:29.765853 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" event={"ID":"56750fed-9157-46b8-9893-2f9f3098e23a","Type":"ContainerStarted","Data":"db6d121c5a2dfb92358b720e546892d8308ed323fe6580866751db9c62ab0473"} Jul 13 07:16:32.783552 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:32.783511 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" event={"ID":"56750fed-9157-46b8-9893-2f9f3098e23a","Type":"ContainerStarted","Data":"57f26a9490eaab992f888b8144206497f099af09a166487eac73a1079f5b97dd"} Jul 13 07:16:32.809053 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:32.808997 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfx6d" podStartSLOduration=2.085118789 podStartE2EDuration="4.808980006s" totalImagesPullingTime="2.723861217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:16:32.806793565 +0000 UTC m=+282.007570578" watchObservedRunningTime="2026-07-13 07:16:32.808980006 +0000 UTC m=+282.009757023" Jul 13 07:16:36.027508 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.027469 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cknnt"] Jul 13 07:16:36.029936 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.029917 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" Jul 13 07:16:36.033176 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.033147 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 07:16:36.033328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.033147 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 07:16:36.034135 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.034118 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fjprs\"" Jul 13 07:16:36.040157 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.040120 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cknnt"] Jul 13 07:16:36.040437 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.040414 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cknnt\" (UID: \"92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" Jul 13 07:16:36.040518 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.040479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcm8q\" (UniqueName: \"kubernetes.io/projected/92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea-kube-api-access-hcm8q\") pod \"cert-manager-cainjector-559cdd8c87-cknnt\" (UID: \"92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" Jul 13 07:16:36.141513 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.141472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcm8q\" (UniqueName: \"kubernetes.io/projected/92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea-kube-api-access-hcm8q\") pod \"cert-manager-cainjector-559cdd8c87-cknnt\" (UID: \"92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" Jul 13 07:16:36.141734 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.141554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cknnt\" (UID: \"92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" Jul 13 07:16:36.149776 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.149742 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cknnt\" (UID: \"92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" Jul 13 07:16:36.150039 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.150016 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcm8q\" (UniqueName: \"kubernetes.io/projected/92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea-kube-api-access-hcm8q\") pod \"cert-manager-cainjector-559cdd8c87-cknnt\" (UID: \"92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" Jul 13 07:16:36.353933 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.353816 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" Jul 13 07:16:36.487740 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.487716 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cknnt"] Jul 13 07:16:36.490314 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:16:36.490281 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92b3d8ff_03cb_45b6_b87e_0bbd2ffe63ea.slice/crio-0cd2c6fb48059499481cc33b71a6fd3f74df91477e8b57d7cffc07220d243d82 WatchSource:0}: Error finding container 0cd2c6fb48059499481cc33b71a6fd3f74df91477e8b57d7cffc07220d243d82: Status 404 returned error can't find the container with id 0cd2c6fb48059499481cc33b71a6fd3f74df91477e8b57d7cffc07220d243d82 Jul 13 07:16:36.802274 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:36.802236 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" event={"ID":"92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea","Type":"ContainerStarted","Data":"0cd2c6fb48059499481cc33b71a6fd3f74df91477e8b57d7cffc07220d243d82"} Jul 13 07:16:41.824026 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:41.823988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" event={"ID":"92b3d8ff-03cb-45b6-b87e-0bbd2ffe63ea","Type":"ContainerStarted","Data":"9b63d1c9c630bcafb04f149aa828cf3318bc010f6ef4f38eb81815131e2fa434"} Jul 13 07:16:41.839548 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:41.839490 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cknnt" podStartSLOduration=1.409571809 podStartE2EDuration="5.839470464s" totalImagesPullingTime="4.429898655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:16:41.839028864 +0000 UTC m=+291.039805881" watchObservedRunningTime="2026-07-13 07:16:41.839470464 +0000 UTC m=+291.040247481" Jul 13 07:16:51.234689 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:51.234660 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:16:51.236848 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:51.236824 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:16:51.240626 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:51.240596 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:16:51.243342 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:51.243310 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:16:51.246825 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:16:51.246795 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 07:17:02.810285 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.810248 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd"] Jul 13 07:17:02.813046 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.813028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.817296 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.817270 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 07:17:02.817439 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.817327 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 07:17:02.817439 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.817390 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bfvgg\"" Jul 13 07:17:02.817558 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.817456 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 07:17:02.817735 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.817719 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 07:17:02.830713 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.830677 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd"] Jul 13 07:17:02.842454 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.842398 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fc7badd-599b-4563-9a24-88900f32c9df-manifests\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.842686 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.842481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fc7badd-599b-4563-9a24-88900f32c9df-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.842686 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.842632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fc7badd-599b-4563-9a24-88900f32c9df-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.842686 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.842681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fc7badd-599b-4563-9a24-88900f32c9df-tmp\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.842807 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.842702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz7tn\" (UniqueName: \"kubernetes.io/projected/1fc7badd-599b-4563-9a24-88900f32c9df-kube-api-access-nz7tn\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.944012 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.943973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fc7badd-599b-4563-9a24-88900f32c9df-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.944012 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.944016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fc7badd-599b-4563-9a24-88900f32c9df-tmp\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.944314 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.944038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz7tn\" (UniqueName: \"kubernetes.io/projected/1fc7badd-599b-4563-9a24-88900f32c9df-kube-api-access-nz7tn\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.944314 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.944097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fc7badd-599b-4563-9a24-88900f32c9df-manifests\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.944314 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.944123 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fc7badd-599b-4563-9a24-88900f32c9df-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.944614 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.944593 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fc7badd-599b-4563-9a24-88900f32c9df-manifests\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.946682 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.946652 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fc7badd-599b-4563-9a24-88900f32c9df-tmp\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.946812 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.946757 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fc7badd-599b-4563-9a24-88900f32c9df-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.946872 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.946831 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fc7badd-599b-4563-9a24-88900f32c9df-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:02.954770 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:02.954739 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz7tn\" (UniqueName: \"kubernetes.io/projected/1fc7badd-599b-4563-9a24-88900f32c9df-kube-api-access-nz7tn\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-jhrcd\" (UID: \"1fc7badd-599b-4563-9a24-88900f32c9df\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:03.123693 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:03.123595 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:03.267331 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:03.267274 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd"] Jul 13 07:17:03.270399 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:17:03.270364 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc7badd_599b_4563_9a24_88900f32c9df.slice/crio-4a240b76ddca986dea14b216d7287e2b7f7907543df96bce4245ee28e08551ae WatchSource:0}: Error finding container 4a240b76ddca986dea14b216d7287e2b7f7907543df96bce4245ee28e08551ae: Status 404 returned error can't find the container with id 4a240b76ddca986dea14b216d7287e2b7f7907543df96bce4245ee28e08551ae Jul 13 07:17:03.272085 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:03.272046 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 07:17:03.919221 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:03.919173 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" event={"ID":"1fc7badd-599b-4563-9a24-88900f32c9df","Type":"ContainerStarted","Data":"4a240b76ddca986dea14b216d7287e2b7f7907543df96bce4245ee28e08551ae"} Jul 13 07:17:06.936830 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:06.936788 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" event={"ID":"1fc7badd-599b-4563-9a24-88900f32c9df","Type":"ContainerStarted","Data":"5d3a2aeb08a39b3ff8fc08ea537d962e93e699087fcd67ec40edc3c9c06ea2ce"} Jul 13 07:17:07.943169 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:07.943077 2561 generic.go:356] "Generic (PLEG): container finished" podID="1fc7badd-599b-4563-9a24-88900f32c9df" containerID="5d3a2aeb08a39b3ff8fc08ea537d962e93e699087fcd67ec40edc3c9c06ea2ce" exitCode=0 Jul 13 07:17:07.943169 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:07.943128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" event={"ID":"1fc7badd-599b-4563-9a24-88900f32c9df","Type":"ContainerDied","Data":"5d3a2aeb08a39b3ff8fc08ea537d962e93e699087fcd67ec40edc3c9c06ea2ce"} Jul 13 07:17:08.949565 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:08.949529 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" event={"ID":"1fc7badd-599b-4563-9a24-88900f32c9df","Type":"ContainerStarted","Data":"86ab830fe0ca742b9f1708c590598aafec867969f89e284d38e1c6e3405760da"} Jul 13 07:17:08.949966 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:08.949646 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:08.974052 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:08.973994 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" podStartSLOduration=2.34833747 podStartE2EDuration="6.973976816s" totalImagesPullingTime="3.535427929s" totalInitContainerRuntime="1.090211417s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:08.972555061 +0000 UTC m=+318.173332097" watchObservedRunningTime="2026-07-13 07:17:08.973976816 +0000 UTC m=+318.174753833" Jul 13 07:17:19.956413 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:19.956379 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-jhrcd" Jul 13 07:17:21.511256 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.511217 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl"] Jul 13 07:17:21.514528 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.514505 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.518287 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.518155 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 07:17:21.518287 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.518169 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 07:17:21.518287 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.518167 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:17:21.518287 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.518189 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4gjfc\"" Jul 13 07:17:21.518287 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.518170 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 07:17:21.518287 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.518175 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 07:17:21.525768 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.525747 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl"] Jul 13 07:17:21.609188 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.609135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1d50726-09a3-4c73-ad77-e8ae69146804-cert\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.609384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.609230 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1d50726-09a3-4c73-ad77-e8ae69146804-manager-config\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.609384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.609250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxlcr\" (UniqueName: \"kubernetes.io/projected/e1d50726-09a3-4c73-ad77-e8ae69146804-kube-api-access-rxlcr\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.609384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.609268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1d50726-09a3-4c73-ad77-e8ae69146804-metrics-cert\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.709929 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.709867 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1d50726-09a3-4c73-ad77-e8ae69146804-manager-config\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.709929 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.709927 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxlcr\" (UniqueName: \"kubernetes.io/projected/e1d50726-09a3-4c73-ad77-e8ae69146804-kube-api-access-rxlcr\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.710224 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.709962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1d50726-09a3-4c73-ad77-e8ae69146804-metrics-cert\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.710224 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.710015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1d50726-09a3-4c73-ad77-e8ae69146804-cert\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.710621 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.710597 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1d50726-09a3-4c73-ad77-e8ae69146804-manager-config\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.713050 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.713023 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1d50726-09a3-4c73-ad77-e8ae69146804-metrics-cert\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.713211 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.713128 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1d50726-09a3-4c73-ad77-e8ae69146804-cert\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.718632 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.718602 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxlcr\" (UniqueName: \"kubernetes.io/projected/e1d50726-09a3-4c73-ad77-e8ae69146804-kube-api-access-rxlcr\") pod \"lws-controller-manager-67b5465ff8-w5vzl\" (UID: \"e1d50726-09a3-4c73-ad77-e8ae69146804\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.823905 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.823815 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:21.973931 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:21.973896 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl"] Jul 13 07:17:21.977020 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:17:21.976980 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d50726_09a3_4c73_ad77_e8ae69146804.slice/crio-e2b52be3ac9bf5aca6e29175d0789d4fcc35e4e17d630190239a437e3d387732 WatchSource:0}: Error finding container e2b52be3ac9bf5aca6e29175d0789d4fcc35e4e17d630190239a437e3d387732: Status 404 returned error can't find the container with id e2b52be3ac9bf5aca6e29175d0789d4fcc35e4e17d630190239a437e3d387732 Jul 13 07:17:22.010696 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:22.010657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" event={"ID":"e1d50726-09a3-4c73-ad77-e8ae69146804","Type":"ContainerStarted","Data":"e2b52be3ac9bf5aca6e29175d0789d4fcc35e4e17d630190239a437e3d387732"} Jul 13 07:17:25.027513 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:25.027471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" event={"ID":"e1d50726-09a3-4c73-ad77-e8ae69146804","Type":"ContainerStarted","Data":"afa9aa9458e817cb8b6e17bb020754ccd3e6de624e23b6e6ad8ba66485cad1e5"} Jul 13 07:17:25.027890 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:25.027618 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:25.044460 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:25.044412 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" podStartSLOduration=1.72713649 podStartE2EDuration="4.044398796s" totalImagesPullingTime="2.317262306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:25.043267291 +0000 UTC m=+334.244044312" watchObservedRunningTime="2026-07-13 07:17:25.044398796 +0000 UTC m=+334.245175812" Jul 13 07:17:32.283734 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.283702 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f"] Jul 13 07:17:32.287227 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.287209 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.289801 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.289768 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 07:17:32.289801 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.289771 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 07:17:32.290036 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.289811 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 07:17:32.290036 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.289842 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 07:17:32.290036 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.289877 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gpgf2\"" Jul 13 07:17:32.306792 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.306761 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f"] Jul 13 07:17:32.405787 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.405741 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.405787 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.405797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.406041 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.405886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.406041 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.405943 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.406041 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.405982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.406041 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.406036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.406219 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.406052 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jfxp\" (UniqueName: \"kubernetes.io/projected/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-kube-api-access-7jfxp\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.507047 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.507003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.507047 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.507053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.507308 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.507180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.507308 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.507216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.507308 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.507236 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jfxp\" (UniqueName: \"kubernetes.io/projected/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-kube-api-access-7jfxp\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.507308 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.507302 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.507729 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.507706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.507857 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.507831 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.509594 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.509566 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.510230 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.510201 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.510313 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.510216 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.510313 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.510280 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.516972 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.516933 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.517293 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.517273 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jfxp\" (UniqueName: \"kubernetes.io/projected/06b150c3-5d0f-4a71-ad42-d6f50c3dbfad-kube-api-access-7jfxp\") pod \"istiod-openshift-gateway-94bb8fbfd-lc75f\" (UID: \"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.596160 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.596035 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:32.771859 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:32.771829 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f"] Jul 13 07:17:32.772639 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:17:32.772610 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b150c3_5d0f_4a71_ad42_d6f50c3dbfad.slice/crio-33a7cda17e46e2cfae0a23e58438c7c941eab13f383c870cb3de4ed149cde720 WatchSource:0}: Error finding container 33a7cda17e46e2cfae0a23e58438c7c941eab13f383c870cb3de4ed149cde720: Status 404 returned error can't find the container with id 33a7cda17e46e2cfae0a23e58438c7c941eab13f383c870cb3de4ed149cde720 Jul 13 07:17:33.064920 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:33.064883 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" event={"ID":"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad","Type":"ContainerStarted","Data":"33a7cda17e46e2cfae0a23e58438c7c941eab13f383c870cb3de4ed149cde720"} Jul 13 07:17:34.914638 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:34.914585 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 07:17:34.915017 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:34.914657 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 07:17:35.076355 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:35.076321 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" event={"ID":"06b150c3-5d0f-4a71-ad42-d6f50c3dbfad","Type":"ContainerStarted","Data":"c83c0446bf72031c656a5712d85d7721e726c0bc188e3a816d639deb8ad72fdc"} Jul 13 07:17:35.076543 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:35.076386 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:17:35.078083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:35.078033 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-lc75f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 07:17:35.078198 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:35.078108 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" podUID="06b150c3-5d0f-4a71-ad42-d6f50c3dbfad" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 07:17:35.121447 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:35.121385 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" podStartSLOduration=0.981660565 podStartE2EDuration="3.121362716s" totalImagesPullingTime="2.139702151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:35.119587341 +0000 UTC m=+344.320364378" watchObservedRunningTime="2026-07-13 07:17:35.121362716 +0000 UTC m=+344.322139735" Jul 13 07:17:36.033645 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:36.033615 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-w5vzl" Jul 13 07:17:36.081472 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:17:36.081444 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lc75f" Jul 13 07:18:52.981696 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:18:52.981645 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-799584c6cc-xqgsx"] Jul 13 07:19:18.007670 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.007557 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-799584c6cc-xqgsx" podUID="4892081f-1c79-411b-957f-6693a5473f65" containerName="console" containerID="cri-o://0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951" gracePeriod=15 Jul 13 07:19:18.266996 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.266909 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:19:18.421853 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.421810 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-oauth-config\") pod \"4892081f-1c79-411b-957f-6693a5473f65\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " Jul 13 07:19:18.422037 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.421875 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-serving-cert\") pod \"4892081f-1c79-411b-957f-6693a5473f65\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " Jul 13 07:19:18.422037 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.421901 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-service-ca\") pod \"4892081f-1c79-411b-957f-6693a5473f65\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " Jul 13 07:19:18.422037 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.421937 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfj2v\" (UniqueName: \"kubernetes.io/projected/4892081f-1c79-411b-957f-6693a5473f65-kube-api-access-kfj2v\") pod \"4892081f-1c79-411b-957f-6693a5473f65\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " Jul 13 07:19:18.422037 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.421970 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-trusted-ca-bundle\") pod \"4892081f-1c79-411b-957f-6693a5473f65\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " Jul 13 07:19:18.422256 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.422141 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-oauth-serving-cert\") pod \"4892081f-1c79-411b-957f-6693a5473f65\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " Jul 13 07:19:18.422256 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.422184 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-console-config\") pod \"4892081f-1c79-411b-957f-6693a5473f65\" (UID: \"4892081f-1c79-411b-957f-6693a5473f65\") " Jul 13 07:19:18.422697 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.422410 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-service-ca" (OuterVolumeSpecName: "service-ca") pod "4892081f-1c79-411b-957f-6693a5473f65" (UID: "4892081f-1c79-411b-957f-6693a5473f65"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:19:18.422697 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.422464 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4892081f-1c79-411b-957f-6693a5473f65" (UID: "4892081f-1c79-411b-957f-6693a5473f65"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:19:18.422697 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.422517 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4892081f-1c79-411b-957f-6693a5473f65" (UID: "4892081f-1c79-411b-957f-6693a5473f65"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:19:18.422874 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.422728 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-console-config" (OuterVolumeSpecName: "console-config") pod "4892081f-1c79-411b-957f-6693a5473f65" (UID: "4892081f-1c79-411b-957f-6693a5473f65"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:19:18.424355 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.424334 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4892081f-1c79-411b-957f-6693a5473f65" (UID: "4892081f-1c79-411b-957f-6693a5473f65"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:19:18.424689 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.424667 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4892081f-1c79-411b-957f-6693a5473f65-kube-api-access-kfj2v" (OuterVolumeSpecName: "kube-api-access-kfj2v") pod "4892081f-1c79-411b-957f-6693a5473f65" (UID: "4892081f-1c79-411b-957f-6693a5473f65"). InnerVolumeSpecName "kube-api-access-kfj2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:19:18.424749 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.424688 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4892081f-1c79-411b-957f-6693a5473f65" (UID: "4892081f-1c79-411b-957f-6693a5473f65"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:19:18.523495 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.523397 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-oauth-config\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:19:18.523495 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.523433 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4892081f-1c79-411b-957f-6693a5473f65-console-serving-cert\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:19:18.523495 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.523443 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-service-ca\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:19:18.523495 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.523451 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfj2v\" (UniqueName: \"kubernetes.io/projected/4892081f-1c79-411b-957f-6693a5473f65-kube-api-access-kfj2v\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:19:18.523748 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.523464 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-trusted-ca-bundle\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:19:18.523748 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.523520 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-oauth-serving-cert\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:19:18.523748 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.523528 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4892081f-1c79-411b-957f-6693a5473f65-console-config\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:19:18.533718 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.533676 2561 generic.go:356] "Generic (PLEG): container finished" podID="4892081f-1c79-411b-957f-6693a5473f65" containerID="0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951" exitCode=0 Jul 13 07:19:18.533917 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.533735 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799584c6cc-xqgsx" Jul 13 07:19:18.533917 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.533736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799584c6cc-xqgsx" event={"ID":"4892081f-1c79-411b-957f-6693a5473f65","Type":"ContainerDied","Data":"0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951"} Jul 13 07:19:18.533917 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.533796 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799584c6cc-xqgsx" event={"ID":"4892081f-1c79-411b-957f-6693a5473f65","Type":"ContainerDied","Data":"aebf711f196affea9a807cee7fa499a7c68d7b967bbe22e750d09698f94a647f"} Jul 13 07:19:18.533917 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.533840 2561 scope.go:117] "RemoveContainer" containerID="0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951" Jul 13 07:19:18.543718 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.543696 2561 scope.go:117] "RemoveContainer" containerID="0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951" Jul 13 07:19:18.544116 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:19:18.544086 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951\": container with ID starting with 0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951 not found: ID does not exist" containerID="0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951" Jul 13 07:19:18.544199 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.544133 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951"} err="failed to get container status \"0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951\": rpc error: code = NotFound desc = could not find container \"0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951\": container with ID starting with 0db8c901c4eb4e8cee1dbc22f8564b213d44479ecfe8b6c406a78c896f176951 not found: ID does not exist" Jul 13 07:19:18.555575 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.555539 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-799584c6cc-xqgsx"] Jul 13 07:19:18.560084 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:18.560035 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-799584c6cc-xqgsx"] Jul 13 07:19:19.340918 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:19.340874 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4892081f-1c79-411b-957f-6693a5473f65" path="/var/lib/kubelet/pods/4892081f-1c79-411b-957f-6693a5473f65/volumes" Jul 13 07:19:43.548312 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.548276 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5kfr"] Jul 13 07:19:43.548738 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.548587 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4892081f-1c79-411b-957f-6693a5473f65" containerName="console" Jul 13 07:19:43.548738 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.548598 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4892081f-1c79-411b-957f-6693a5473f65" containerName="console" Jul 13 07:19:43.548738 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.548680 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4892081f-1c79-411b-957f-6693a5473f65" containerName="console" Jul 13 07:19:43.551389 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.551372 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k5kfr" Jul 13 07:19:43.554113 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.554089 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 07:19:43.555135 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.555097 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ln28\"" Jul 13 07:19:43.555367 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.555346 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 07:19:43.557104 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.557080 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5kfr"] Jul 13 07:19:43.636449 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.636412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtrgz\" (UniqueName: \"kubernetes.io/projected/aef1623b-d9f3-457f-ac24-c47e028b8cbe-kube-api-access-wtrgz\") pod \"authorino-75d556bd77-k5kfr\" (UID: \"aef1623b-d9f3-457f-ac24-c47e028b8cbe\") " pod="kuadrant-system/authorino-75d556bd77-k5kfr" Jul 13 07:19:43.737770 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.737723 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtrgz\" (UniqueName: \"kubernetes.io/projected/aef1623b-d9f3-457f-ac24-c47e028b8cbe-kube-api-access-wtrgz\") pod \"authorino-75d556bd77-k5kfr\" (UID: \"aef1623b-d9f3-457f-ac24-c47e028b8cbe\") " pod="kuadrant-system/authorino-75d556bd77-k5kfr" Jul 13 07:19:43.747752 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.747717 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtrgz\" (UniqueName: \"kubernetes.io/projected/aef1623b-d9f3-457f-ac24-c47e028b8cbe-kube-api-access-wtrgz\") pod \"authorino-75d556bd77-k5kfr\" (UID: \"aef1623b-d9f3-457f-ac24-c47e028b8cbe\") " pod="kuadrant-system/authorino-75d556bd77-k5kfr" Jul 13 07:19:43.861750 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:43.861641 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k5kfr" Jul 13 07:19:44.001884 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:44.001661 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5kfr"] Jul 13 07:19:44.004933 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:19:44.004906 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaef1623b_d9f3_457f_ac24_c47e028b8cbe.slice/crio-57100023a5278d08e94b2cceeea81dac16c6500793d42e2927f389cf74e71737 WatchSource:0}: Error finding container 57100023a5278d08e94b2cceeea81dac16c6500793d42e2927f389cf74e71737: Status 404 returned error can't find the container with id 57100023a5278d08e94b2cceeea81dac16c6500793d42e2927f389cf74e71737 Jul 13 07:19:44.662116 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:44.662052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k5kfr" event={"ID":"aef1623b-d9f3-457f-ac24-c47e028b8cbe","Type":"ContainerStarted","Data":"57100023a5278d08e94b2cceeea81dac16c6500793d42e2927f389cf74e71737"} Jul 13 07:19:47.679557 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:47.679518 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k5kfr" event={"ID":"aef1623b-d9f3-457f-ac24-c47e028b8cbe","Type":"ContainerStarted","Data":"5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4"} Jul 13 07:19:47.698628 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:47.698569 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-k5kfr" podStartSLOduration=1.556548418 podStartE2EDuration="4.698550131s" totalImagesPullingTime="3.142001713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:47.696239082 +0000 UTC m=+476.897016098" watchObservedRunningTime="2026-07-13 07:19:47.698550131 +0000 UTC m=+476.899327147" Jul 13 07:19:48.410308 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.410274 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:19:48.413726 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.413702 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" Jul 13 07:19:48.416153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.416128 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 07:19:48.416153 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.416138 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6n99k\"" Jul 13 07:19:48.420921 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.420892 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:19:48.444853 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.444814 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:19:48.483631 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.483588 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31375aeb-1d09-419d-ad58-81025a2c49ec-config-file\") pod \"limitador-limitador-54d6d988d5-dhnkc\" (UID: \"31375aeb-1d09-419d-ad58-81025a2c49ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" Jul 13 07:19:48.483838 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.483642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5s9n\" (UniqueName: \"kubernetes.io/projected/31375aeb-1d09-419d-ad58-81025a2c49ec-kube-api-access-w5s9n\") pod \"limitador-limitador-54d6d988d5-dhnkc\" (UID: \"31375aeb-1d09-419d-ad58-81025a2c49ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" Jul 13 07:19:48.584964 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.584923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31375aeb-1d09-419d-ad58-81025a2c49ec-config-file\") pod \"limitador-limitador-54d6d988d5-dhnkc\" (UID: \"31375aeb-1d09-419d-ad58-81025a2c49ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" Jul 13 07:19:48.585267 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.584982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5s9n\" (UniqueName: \"kubernetes.io/projected/31375aeb-1d09-419d-ad58-81025a2c49ec-kube-api-access-w5s9n\") pod \"limitador-limitador-54d6d988d5-dhnkc\" (UID: \"31375aeb-1d09-419d-ad58-81025a2c49ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" Jul 13 07:19:48.585662 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.585638 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31375aeb-1d09-419d-ad58-81025a2c49ec-config-file\") pod \"limitador-limitador-54d6d988d5-dhnkc\" (UID: \"31375aeb-1d09-419d-ad58-81025a2c49ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" Jul 13 07:19:48.595464 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.595435 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5s9n\" (UniqueName: \"kubernetes.io/projected/31375aeb-1d09-419d-ad58-81025a2c49ec-kube-api-access-w5s9n\") pod \"limitador-limitador-54d6d988d5-dhnkc\" (UID: \"31375aeb-1d09-419d-ad58-81025a2c49ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" Jul 13 07:19:48.725518 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.725480 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" Jul 13 07:19:48.870561 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:48.870535 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:19:48.873447 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:19:48.873414 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31375aeb_1d09_419d_ad58_81025a2c49ec.slice/crio-12ea0edd81c796ae021e47580fdc1d286bdd6fa56b385a977e7d23c35badfb09 WatchSource:0}: Error finding container 12ea0edd81c796ae021e47580fdc1d286bdd6fa56b385a977e7d23c35badfb09: Status 404 returned error can't find the container with id 12ea0edd81c796ae021e47580fdc1d286bdd6fa56b385a977e7d23c35badfb09 Jul 13 07:19:49.690830 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:49.690780 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" event={"ID":"31375aeb-1d09-419d-ad58-81025a2c49ec","Type":"ContainerStarted","Data":"12ea0edd81c796ae021e47580fdc1d286bdd6fa56b385a977e7d23c35badfb09"} Jul 13 07:19:51.702969 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:51.702866 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" event={"ID":"31375aeb-1d09-419d-ad58-81025a2c49ec","Type":"ContainerStarted","Data":"ad7e691db90fd1565a3b342839ce271899c4cf495c67392eef5fbb958fc5852b"} Jul 13 07:19:51.702969 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:51.702959 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" Jul 13 07:19:51.720268 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:19:51.720206 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" podStartSLOduration=1.26532621 podStartE2EDuration="3.720188874s" totalImagesPullingTime="2.454862664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:51.719359584 +0000 UTC m=+480.920136619" watchObservedRunningTime="2026-07-13 07:19:51.720188874 +0000 UTC m=+480.920965890" Jul 13 07:20:02.708342 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:02.708309 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dhnkc" Jul 13 07:20:18.891464 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:18.891420 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5kfr"] Jul 13 07:20:18.892010 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:18.891629 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-k5kfr" podUID="aef1623b-d9f3-457f-ac24-c47e028b8cbe" containerName="authorino" containerID="cri-o://5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4" gracePeriod=30 Jul 13 07:20:19.153182 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.153105 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k5kfr" Jul 13 07:20:19.163604 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.163574 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtrgz\" (UniqueName: \"kubernetes.io/projected/aef1623b-d9f3-457f-ac24-c47e028b8cbe-kube-api-access-wtrgz\") pod \"aef1623b-d9f3-457f-ac24-c47e028b8cbe\" (UID: \"aef1623b-d9f3-457f-ac24-c47e028b8cbe\") " Jul 13 07:20:19.165961 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.165933 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef1623b-d9f3-457f-ac24-c47e028b8cbe-kube-api-access-wtrgz" (OuterVolumeSpecName: "kube-api-access-wtrgz") pod "aef1623b-d9f3-457f-ac24-c47e028b8cbe" (UID: "aef1623b-d9f3-457f-ac24-c47e028b8cbe"). InnerVolumeSpecName "kube-api-access-wtrgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:20:19.264278 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.264240 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtrgz\" (UniqueName: \"kubernetes.io/projected/aef1623b-d9f3-457f-ac24-c47e028b8cbe-kube-api-access-wtrgz\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:20:19.828410 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.828376 2561 generic.go:356] "Generic (PLEG): container finished" podID="aef1623b-d9f3-457f-ac24-c47e028b8cbe" containerID="5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4" exitCode=0 Jul 13 07:20:19.828601 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.828421 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k5kfr" Jul 13 07:20:19.828601 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.828445 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k5kfr" event={"ID":"aef1623b-d9f3-457f-ac24-c47e028b8cbe","Type":"ContainerDied","Data":"5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4"} Jul 13 07:20:19.828601 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.828476 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k5kfr" event={"ID":"aef1623b-d9f3-457f-ac24-c47e028b8cbe","Type":"ContainerDied","Data":"57100023a5278d08e94b2cceeea81dac16c6500793d42e2927f389cf74e71737"} Jul 13 07:20:19.828601 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.828491 2561 scope.go:117] "RemoveContainer" containerID="5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4" Jul 13 07:20:19.837198 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.837181 2561 scope.go:117] "RemoveContainer" containerID="5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4" Jul 13 07:20:19.837445 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:20:19.837429 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4\": container with ID starting with 5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4 not found: ID does not exist" containerID="5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4" Jul 13 07:20:19.837483 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.837454 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4"} err="failed to get container status \"5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4\": rpc error: code = NotFound desc = could not find container \"5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4\": container with ID starting with 5a3e18c4579cb7a63c317ccfbe10c78ae33452e39f8690b63a0b74857a246fe4 not found: ID does not exist" Jul 13 07:20:19.846721 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.846695 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5kfr"] Jul 13 07:20:19.852562 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:19.852538 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5kfr"] Jul 13 07:20:21.341016 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:21.340980 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aef1623b-d9f3-457f-ac24-c47e028b8cbe" path="/var/lib/kubelet/pods/aef1623b-d9f3-457f-ac24-c47e028b8cbe/volumes" Jul 13 07:20:23.105464 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.105429 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-559979cdff-ll5nc"] Jul 13 07:20:23.105967 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.105777 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef1623b-d9f3-457f-ac24-c47e028b8cbe" containerName="authorino" Jul 13 07:20:23.105967 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.105788 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef1623b-d9f3-457f-ac24-c47e028b8cbe" containerName="authorino" Jul 13 07:20:23.105967 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.105860 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aef1623b-d9f3-457f-ac24-c47e028b8cbe" containerName="authorino" Jul 13 07:20:23.110169 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.110133 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:23.113555 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.113525 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 07:20:23.113720 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.113560 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hvhts\"" Jul 13 07:20:23.114370 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.114332 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 07:20:23.122443 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.122392 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-559979cdff-ll5nc"] Jul 13 07:20:23.191573 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.191522 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e0617c6-919a-43f7-9edb-7565374749f2-webhook-cert\") pod \"maas-controller-559979cdff-ll5nc\" (UID: \"6e0617c6-919a-43f7-9edb-7565374749f2\") " pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:23.191789 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.191607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgr5d\" (UniqueName: \"kubernetes.io/projected/6e0617c6-919a-43f7-9edb-7565374749f2-kube-api-access-lgr5d\") pod \"maas-controller-559979cdff-ll5nc\" (UID: \"6e0617c6-919a-43f7-9edb-7565374749f2\") " pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:23.292147 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.292103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgr5d\" (UniqueName: \"kubernetes.io/projected/6e0617c6-919a-43f7-9edb-7565374749f2-kube-api-access-lgr5d\") pod \"maas-controller-559979cdff-ll5nc\" (UID: \"6e0617c6-919a-43f7-9edb-7565374749f2\") " pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:23.292343 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.292207 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e0617c6-919a-43f7-9edb-7565374749f2-webhook-cert\") pod \"maas-controller-559979cdff-ll5nc\" (UID: \"6e0617c6-919a-43f7-9edb-7565374749f2\") " pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:23.292387 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:20:23.292353 2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 13 07:20:23.292446 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:20:23.292435 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0617c6-919a-43f7-9edb-7565374749f2-webhook-cert podName:6e0617c6-919a-43f7-9edb-7565374749f2 nodeName:}" failed. No retries permitted until 2026-07-13 07:20:23.792417273 +0000 UTC m=+512.993194269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6e0617c6-919a-43f7-9edb-7565374749f2-webhook-cert") pod "maas-controller-559979cdff-ll5nc" (UID: "6e0617c6-919a-43f7-9edb-7565374749f2") : secret "maas-controller-webhook-cert" not found Jul 13 07:20:23.304124 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.304096 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgr5d\" (UniqueName: \"kubernetes.io/projected/6e0617c6-919a-43f7-9edb-7565374749f2-kube-api-access-lgr5d\") pod \"maas-controller-559979cdff-ll5nc\" (UID: \"6e0617c6-919a-43f7-9edb-7565374749f2\") " pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:23.796996 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.796947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e0617c6-919a-43f7-9edb-7565374749f2-webhook-cert\") pod \"maas-controller-559979cdff-ll5nc\" (UID: \"6e0617c6-919a-43f7-9edb-7565374749f2\") " pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:23.799732 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:23.799706 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e0617c6-919a-43f7-9edb-7565374749f2-webhook-cert\") pod \"maas-controller-559979cdff-ll5nc\" (UID: \"6e0617c6-919a-43f7-9edb-7565374749f2\") " pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:24.022441 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:24.022379 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:24.169290 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:24.169261 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-559979cdff-ll5nc"] Jul 13 07:20:24.172214 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:20:24.172171 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0617c6_919a_43f7_9edb_7565374749f2.slice/crio-3361c0a89c80f004ad11bf4d0e9d76fc00a10dbebe774151bd8c7a8fb6d5a37d WatchSource:0}: Error finding container 3361c0a89c80f004ad11bf4d0e9d76fc00a10dbebe774151bd8c7a8fb6d5a37d: Status 404 returned error can't find the container with id 3361c0a89c80f004ad11bf4d0e9d76fc00a10dbebe774151bd8c7a8fb6d5a37d Jul 13 07:20:24.854874 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:24.854825 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-559979cdff-ll5nc" event={"ID":"6e0617c6-919a-43f7-9edb-7565374749f2","Type":"ContainerStarted","Data":"3361c0a89c80f004ad11bf4d0e9d76fc00a10dbebe774151bd8c7a8fb6d5a37d"} Jul 13 07:20:26.865040 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:26.865000 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-559979cdff-ll5nc" event={"ID":"6e0617c6-919a-43f7-9edb-7565374749f2","Type":"ContainerStarted","Data":"2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268"} Jul 13 07:20:26.865494 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:26.865129 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:26.883481 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:26.883427 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-559979cdff-ll5nc" podStartSLOduration=1.688597548 podStartE2EDuration="3.883406275s" totalImagesPullingTime="2.194808727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:20:26.882808347 +0000 UTC m=+516.083585364" watchObservedRunningTime="2026-07-13 07:20:26.883406275 +0000 UTC m=+516.084183292" Jul 13 07:20:37.875721 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:37.875679 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:38.437747 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.437705 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-559979cdff-ll5nc"] Jul 13 07:20:38.437998 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.437945 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-559979cdff-ll5nc" podUID="6e0617c6-919a-43f7-9edb-7565374749f2" containerName="manager" containerID="cri-o://2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268" gracePeriod=30 Jul 13 07:20:38.688814 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.688740 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:38.719835 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.719795 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgr5d\" (UniqueName: \"kubernetes.io/projected/6e0617c6-919a-43f7-9edb-7565374749f2-kube-api-access-lgr5d\") pod \"6e0617c6-919a-43f7-9edb-7565374749f2\" (UID: \"6e0617c6-919a-43f7-9edb-7565374749f2\") " Jul 13 07:20:38.720005 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.719857 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e0617c6-919a-43f7-9edb-7565374749f2-webhook-cert\") pod \"6e0617c6-919a-43f7-9edb-7565374749f2\" (UID: \"6e0617c6-919a-43f7-9edb-7565374749f2\") " Jul 13 07:20:38.722421 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.722383 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e0617c6-919a-43f7-9edb-7565374749f2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6e0617c6-919a-43f7-9edb-7565374749f2" (UID: "6e0617c6-919a-43f7-9edb-7565374749f2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:20:38.722589 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.722451 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e0617c6-919a-43f7-9edb-7565374749f2-kube-api-access-lgr5d" (OuterVolumeSpecName: "kube-api-access-lgr5d") pod "6e0617c6-919a-43f7-9edb-7565374749f2" (UID: "6e0617c6-919a-43f7-9edb-7565374749f2"). InnerVolumeSpecName "kube-api-access-lgr5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:20:38.820624 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.820558 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e0617c6-919a-43f7-9edb-7565374749f2-webhook-cert\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:20:38.820624 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.820617 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgr5d\" (UniqueName: \"kubernetes.io/projected/6e0617c6-919a-43f7-9edb-7565374749f2-kube-api-access-lgr5d\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:20:38.922013 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.921973 2561 generic.go:356] "Generic (PLEG): container finished" podID="6e0617c6-919a-43f7-9edb-7565374749f2" containerID="2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268" exitCode=0 Jul 13 07:20:38.922523 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.922024 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-559979cdff-ll5nc" Jul 13 07:20:38.922523 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.922054 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-559979cdff-ll5nc" event={"ID":"6e0617c6-919a-43f7-9edb-7565374749f2","Type":"ContainerDied","Data":"2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268"} Jul 13 07:20:38.922523 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.922132 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-559979cdff-ll5nc" event={"ID":"6e0617c6-919a-43f7-9edb-7565374749f2","Type":"ContainerDied","Data":"3361c0a89c80f004ad11bf4d0e9d76fc00a10dbebe774151bd8c7a8fb6d5a37d"} Jul 13 07:20:38.922523 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.922159 2561 scope.go:117] "RemoveContainer" containerID="2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268" Jul 13 07:20:38.931403 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.931381 2561 scope.go:117] "RemoveContainer" containerID="2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268" Jul 13 07:20:38.931725 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:20:38.931703 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268\": container with ID starting with 2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268 not found: ID does not exist" containerID="2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268" Jul 13 07:20:38.931804 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.931754 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268"} err="failed to get container status \"2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268\": rpc error: code = NotFound desc = could not find container \"2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268\": container with ID starting with 2b0ec2cdaa16f91a0e0725f588d058a19d0c14d0c5093f84177644a3fa33c268 not found: ID does not exist" Jul 13 07:20:38.944283 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.944109 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-559979cdff-ll5nc"] Jul 13 07:20:38.946456 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:38.946427 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-559979cdff-ll5nc"] Jul 13 07:20:39.341857 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:20:39.341818 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e0617c6-919a-43f7-9edb-7565374749f2" path="/var/lib/kubelet/pods/6e0617c6-919a-43f7-9edb-7565374749f2/volumes" Jul 13 07:21:00.104025 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:00.103916 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:21:19.328309 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.328263 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46"] Jul 13 07:21:19.328786 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.328596 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e0617c6-919a-43f7-9edb-7565374749f2" containerName="manager" Jul 13 07:21:19.328786 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.328608 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e0617c6-919a-43f7-9edb-7565374749f2" containerName="manager" Jul 13 07:21:19.328786 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.328678 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e0617c6-919a-43f7-9edb-7565374749f2" containerName="manager" Jul 13 07:21:19.331568 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.331543 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.334406 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.334374 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 07:21:19.334406 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.334377 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 13 07:21:19.335531 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.335508 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 07:21:19.335647 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.335566 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kvj25\"" Jul 13 07:21:19.343000 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.342976 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46"] Jul 13 07:21:19.381640 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.381587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a5ee92-f826-489a-b29c-b73dac53736f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.381846 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.381658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8znj5\" (UniqueName: \"kubernetes.io/projected/b2a5ee92-f826-489a-b29c-b73dac53736f-kube-api-access-8znj5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.381846 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.381730 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.381931 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.381867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.381931 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.381901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.382029 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.381979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.482477 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.482438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.482477 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.482479 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.482716 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.482504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.482716 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.482534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a5ee92-f826-489a-b29c-b73dac53736f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.482716 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.482561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8znj5\" (UniqueName: \"kubernetes.io/projected/b2a5ee92-f826-489a-b29c-b73dac53736f-kube-api-access-8znj5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.482716 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.482588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.482990 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.482967 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.483055 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.482994 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.483055 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.482968 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.485432 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.485406 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a5ee92-f826-489a-b29c-b73dac53736f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.485572 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.485553 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a5ee92-f826-489a-b29c-b73dac53736f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.491448 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.491421 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8znj5\" (UniqueName: \"kubernetes.io/projected/b2a5ee92-f826-489a-b29c-b73dac53736f-kube-api-access-8znj5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46\" (UID: \"b2a5ee92-f826-489a-b29c-b73dac53736f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.644751 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.644638 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:19.789007 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.788976 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46"] Jul 13 07:21:19.792113 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:21:19.792082 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a5ee92_f826_489a_b29c_b73dac53736f.slice/crio-d9ff319fe9c05869abd60209dd58c4b7ddde719b49763e7d78b4e5be2048f1de WatchSource:0}: Error finding container d9ff319fe9c05869abd60209dd58c4b7ddde719b49763e7d78b4e5be2048f1de: Status 404 returned error can't find the container with id d9ff319fe9c05869abd60209dd58c4b7ddde719b49763e7d78b4e5be2048f1de Jul 13 07:21:19.822396 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:19.818642 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:21:20.111357 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:20.111314 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" event={"ID":"b2a5ee92-f826-489a-b29c-b73dac53736f","Type":"ContainerStarted","Data":"d9ff319fe9c05869abd60209dd58c4b7ddde719b49763e7d78b4e5be2048f1de"} Jul 13 07:21:21.118160 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:21.118107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" event={"ID":"b2a5ee92-f826-489a-b29c-b73dac53736f","Type":"ContainerStarted","Data":"3806d004cc51195dcd8b46c2a2aa08bccdb3008c36dbb7db46231307e0d95c5c"} Jul 13 07:21:21.138400 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:21.138332 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" podStartSLOduration=0.920699412 podStartE2EDuration="2.138310783s" totalImagesPullingTime="1.217611371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:21:21.136275209 +0000 UTC m=+570.337052227" watchObservedRunningTime="2026-07-13 07:21:21.138310783 +0000 UTC m=+570.339087799" Jul 13 07:21:28.444803 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:28.444754 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:21:29.645869 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:29.645824 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:29.646313 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:29.645899 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:29.658673 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:29.658641 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:30.171342 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:30.171308 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46" Jul 13 07:21:45.108827 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.108780 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd"] Jul 13 07:21:45.112288 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.112264 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.114706 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.114679 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 13 07:21:45.123030 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.123000 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd"] Jul 13 07:21:45.213950 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.213910 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.213950 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.213951 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.214201 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.213971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8zc9\" (UniqueName: \"kubernetes.io/projected/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-kube-api-access-z8zc9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.214201 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.214009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.214201 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.214078 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.214201 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.214131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.314796 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.314751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.314981 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.314804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.314981 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.314920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.315113 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.315021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.315113 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.315047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.315113 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.315089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zc9\" (UniqueName: \"kubernetes.io/projected/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-kube-api-access-z8zc9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.315327 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.315308 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.315435 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.315413 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.315487 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.315459 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.317337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.317313 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.317500 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.317482 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.324491 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.324464 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8zc9\" (UniqueName: \"kubernetes.io/projected/7293bc1b-8cd2-4e80-ac80-0f3f596af2e2-kube-api-access-z8zc9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h5xgd\" (UID: \"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.425482 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.425372 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:45.574482 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:45.574448 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd"] Jul 13 07:21:45.577306 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:21:45.577271 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7293bc1b_8cd2_4e80_ac80_0f3f596af2e2.slice/crio-52f69b19333e0f433d5eb80e843eed2a5108e6c2de40333092498a2276afdd1e WatchSource:0}: Error finding container 52f69b19333e0f433d5eb80e843eed2a5108e6c2de40333092498a2276afdd1e: Status 404 returned error can't find the container with id 52f69b19333e0f433d5eb80e843eed2a5108e6c2de40333092498a2276afdd1e Jul 13 07:21:46.232210 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:46.232180 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:21:46.235561 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:46.235516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" event={"ID":"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2","Type":"ContainerStarted","Data":"827547661feec190e8852d28e7d4a7b5fb826c15da32aa8f95218102cfa13bc0"} Jul 13 07:21:46.235750 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:46.235569 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" event={"ID":"7293bc1b-8cd2-4e80-ac80-0f3f596af2e2","Type":"ContainerStarted","Data":"52f69b19333e0f433d5eb80e843eed2a5108e6c2de40333092498a2276afdd1e"} Jul 13 07:21:46.261646 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:46.261559 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" podStartSLOduration=1.056074723 podStartE2EDuration="1.261539843s" totalImagesPullingTime="205.46512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:21:46.260957953 +0000 UTC m=+595.461734991" watchObservedRunningTime="2026-07-13 07:21:46.261539843 +0000 UTC m=+595.462316838" Jul 13 07:21:51.266007 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:51.265974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:21:51.266508 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:51.266396 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:21:51.271511 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:51.271481 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:21:51.271925 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:51.271900 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:21:52.232248 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:52.232201 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:21:55.426194 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:55.426141 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:55.426644 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:55.426222 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:55.444277 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:55.444224 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:21:56.291909 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:21:56.291874 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h5xgd" Jul 13 07:22:01.415949 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:22:01.415909 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:22:06.828170 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:22:06.828131 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:24:00.626340 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:24:00.626308 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:24:10.320209 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:24:10.320172 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:24:23.227238 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:24:23.227200 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:24:30.619350 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:24:30.619319 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:24:41.515781 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:24:41.515740 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:25:08.224569 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:25:08.224537 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:25:21.715081 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:25:21.714991 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:25:51.522754 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:25:51.522723 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:26:00.522291 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:00.522259 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:26:10.620506 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:10.620472 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:26:17.920511 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:17.920471 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:26:27.824894 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:27.824852 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:26:39.333766 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:39.333729 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:26:50.214388 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:50.214358 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:26:51.291549 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:51.291521 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:26:51.292146 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:51.292121 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:26:51.296736 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:51.296714 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:26:51.297082 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:51.297044 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:26:59.815185 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:26:59.815148 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:27:22.327422 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:27:22.327391 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:27:31.017018 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:27:31.016980 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:27:52.626798 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:27:52.626761 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:28:02.944961 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:28:02.944924 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:28:20.742570 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:28:20.742499 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:28:31.623522 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:28:31.623489 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:28:41.629010 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:28:41.628973 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:28:51.018540 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:28:51.018506 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:29:00.115155 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:29:00.115116 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:30:48.230592 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:30:48.230561 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:30:59.123134 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:30:59.123096 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:31:10.018746 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:31:10.018709 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:31:20.322118 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:31:20.322015 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:31:31.719328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:31:31.719292 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:31:41.016562 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:31:41.016529 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:31:50.618420 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:31:50.618382 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:31:51.316987 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:31:51.316949 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:31:51.318254 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:31:51.318233 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:31:51.322792 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:31:51.322773 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:31:51.324198 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:31:51.324178 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:32:03.869475 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:32:03.869441 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:32:12.528984 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:32:12.528950 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:32:20.135101 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:32:20.135047 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:32:29.020811 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:32:29.020776 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:32:38.744001 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:32:38.743967 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:32:56.097921 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:32:56.097881 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:33:05.529915 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:33:05.529873 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:33:15.149128 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:33:15.149094 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:33:26.430032 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:33:26.429995 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:33:33.416992 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:33:33.416957 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:33:43.018080 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:33:43.018028 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:33:55.323037 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:33:55.323003 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:34:04.021952 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:34:04.021914 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:34:13.631690 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:34:13.631601 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:34:22.824933 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:34:22.824893 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:34:32.048222 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:34:32.048185 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:34:44.530104 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:34:44.530051 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:34:54.022340 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:34:54.022303 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:35:09.619451 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:35:09.619418 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:35:19.723830 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:35:19.723799 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:35:31.818373 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:35:31.818343 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:35:40.192878 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:35:40.192840 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:35:51.523445 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:35:51.523411 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:36:03.023674 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:36:03.023640 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:36:13.641507 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:36:13.641466 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:36:31.421278 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:36:31.421241 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:36:41.518439 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:36:41.518399 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:36:51.343684 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:36:51.343602 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:36:51.345786 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:36:51.345767 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:36:51.348920 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:36:51.348902 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:36:51.351420 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:36:51.351402 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:36:52.818168 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:36:52.818134 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:37:00.315931 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:37:00.315895 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:37:08.422522 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:37:08.422484 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:38:30.531497 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:38:30.531463 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:38:38.130347 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:38:38.130313 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:38:52.808277 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:38:52.808242 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:39:03.026249 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:39:03.026211 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:39:32.721070 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:39:32.721020 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:39:54.521459 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:39:54.521427 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:40:07.334614 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:40:07.334579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:40:19.825643 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:40:19.825554 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:41:00.221653 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:41:00.221616 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:41:09.830115 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:41:09.830080 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:41:20.128399 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:41:20.128360 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:41:51.368890 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:41:51.368861 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:41:51.372844 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:41:51.372824 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:41:51.374334 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:41:51.374315 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:41:51.377977 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:41:51.377960 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:42:08.220476 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:08.220432 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:42:22.124916 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:22.122338 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:42:24.219198 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.219149 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8"] Jul 13 07:42:24.222816 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.222795 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.226425 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.226396 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7d46e0\"/\"test-model-7d46e0-kserve-self-signed-certs\"" Jul 13 07:42:24.226592 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.226402 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7d46e0\"/\"openshift-service-ca.crt\"" Jul 13 07:42:24.226592 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.226445 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7d46e0\"/\"kube-root-ca.crt\"" Jul 13 07:42:24.226592 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.226401 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7d46e0\"/\"default-dockercfg-rjkdn\"" Jul 13 07:42:24.231833 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.231585 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8"] Jul 13 07:42:24.310390 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.310352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-home\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.310582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.310439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-dshm\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.310582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.310485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-model-cache\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.310582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.310516 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvjdd\" (UniqueName: \"kubernetes.io/projected/3360608f-82fe-434c-92c9-238e4ac8c4a9-kube-api-access-cvjdd\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.310582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.310547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3360608f-82fe-434c-92c9-238e4ac8c4a9-tls-certs\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.310582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.310574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-tmp-dir\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.411993 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.411950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-home\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.412236 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.412010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-dshm\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.412236 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.412187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-model-cache\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.412236 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.412224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvjdd\" (UniqueName: \"kubernetes.io/projected/3360608f-82fe-434c-92c9-238e4ac8c4a9-kube-api-access-cvjdd\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.412410 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.412250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3360608f-82fe-434c-92c9-238e4ac8c4a9-tls-certs\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.412410 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.412277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-tmp-dir\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.412555 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.412533 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-home\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.412627 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.412608 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-model-cache\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.412672 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.412642 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-tmp-dir\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.414496 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.414473 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-dshm\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.414780 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.414762 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3360608f-82fe-434c-92c9-238e4ac8c4a9-tls-certs\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.421658 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.421626 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvjdd\" (UniqueName: \"kubernetes.io/projected/3360608f-82fe-434c-92c9-238e4ac8c4a9-kube-api-access-cvjdd\") pod \"test-model-7d46e0-kserve-958dd6b49-w47q8\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.533762 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.533657 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:24.682442 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:24.682414 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8"] Jul 13 07:42:24.684879 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:42:24.684841 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3360608f_82fe_434c_92c9_238e4ac8c4a9.slice/crio-b2f29d76af20a93131f809d7f9a117f1c268989284489ea6169c8aecd9ba27d4 WatchSource:0}: Error finding container b2f29d76af20a93131f809d7f9a117f1c268989284489ea6169c8aecd9ba27d4: Status 404 returned error can't find the container with id b2f29d76af20a93131f809d7f9a117f1c268989284489ea6169c8aecd9ba27d4 Jul 13 07:42:25.607331 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:25.607296 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" event={"ID":"3360608f-82fe-434c-92c9-238e4ac8c4a9","Type":"ContainerStarted","Data":"3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71"} Jul 13 07:42:25.607331 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:25.607340 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" event={"ID":"3360608f-82fe-434c-92c9-238e4ac8c4a9","Type":"ContainerStarted","Data":"b2f29d76af20a93131f809d7f9a117f1c268989284489ea6169c8aecd9ba27d4"} Jul 13 07:42:25.626439 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:25.626381 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" podStartSLOduration=1.62636062 podStartE2EDuration="1.62636062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:42:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:42:25.625145652 +0000 UTC m=+1834.825922691" watchObservedRunningTime="2026-07-13 07:42:25.62636062 +0000 UTC m=+1834.827137636" Jul 13 07:42:34.534338 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:34.534288 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:34.536751 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:34.534354 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:34.547440 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:34.547402 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:34.664428 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:34.664398 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:42:36.321337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:36.321286 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:42:49.025001 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:42:49.024952 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:43:01.260971 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:01.260934 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8"] Jul 13 07:43:05.912515 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:05.912472 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:43:16.282100 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.281978 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" podUID="3360608f-82fe-434c-92c9-238e4ac8c4a9" containerName="main" containerID="cri-o://3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71" gracePeriod=45 Jul 13 07:43:16.538539 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.538448 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:43:16.689074 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.689024 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-tmp-dir\") pod \"3360608f-82fe-434c-92c9-238e4ac8c4a9\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " Jul 13 07:43:16.689074 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.689109 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvjdd\" (UniqueName: \"kubernetes.io/projected/3360608f-82fe-434c-92c9-238e4ac8c4a9-kube-api-access-cvjdd\") pod \"3360608f-82fe-434c-92c9-238e4ac8c4a9\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " Jul 13 07:43:16.689074 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.689150 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-dshm\") pod \"3360608f-82fe-434c-92c9-238e4ac8c4a9\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " Jul 13 07:43:16.689434 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.689184 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3360608f-82fe-434c-92c9-238e4ac8c4a9-tls-certs\") pod \"3360608f-82fe-434c-92c9-238e4ac8c4a9\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " Jul 13 07:43:16.689434 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.689236 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-home\") pod \"3360608f-82fe-434c-92c9-238e4ac8c4a9\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " Jul 13 07:43:16.689434 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.689294 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-model-cache\") pod \"3360608f-82fe-434c-92c9-238e4ac8c4a9\" (UID: \"3360608f-82fe-434c-92c9-238e4ac8c4a9\") " Jul 13 07:43:16.689434 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.689395 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3360608f-82fe-434c-92c9-238e4ac8c4a9" (UID: "3360608f-82fe-434c-92c9-238e4ac8c4a9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:16.689636 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.689559 2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-tmp-dir\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:43:16.689688 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.689620 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-model-cache" (OuterVolumeSpecName: "model-cache") pod "3360608f-82fe-434c-92c9-238e4ac8c4a9" (UID: "3360608f-82fe-434c-92c9-238e4ac8c4a9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:16.689688 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.689636 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-home" (OuterVolumeSpecName: "home") pod "3360608f-82fe-434c-92c9-238e4ac8c4a9" (UID: "3360608f-82fe-434c-92c9-238e4ac8c4a9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:16.691810 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.691754 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-dshm" (OuterVolumeSpecName: "dshm") pod "3360608f-82fe-434c-92c9-238e4ac8c4a9" (UID: "3360608f-82fe-434c-92c9-238e4ac8c4a9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:16.691810 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.691788 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3360608f-82fe-434c-92c9-238e4ac8c4a9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3360608f-82fe-434c-92c9-238e4ac8c4a9" (UID: "3360608f-82fe-434c-92c9-238e4ac8c4a9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:43:16.691810 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.691802 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3360608f-82fe-434c-92c9-238e4ac8c4a9-kube-api-access-cvjdd" (OuterVolumeSpecName: "kube-api-access-cvjdd") pod "3360608f-82fe-434c-92c9-238e4ac8c4a9" (UID: "3360608f-82fe-434c-92c9-238e4ac8c4a9"). InnerVolumeSpecName "kube-api-access-cvjdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:43:16.790176 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.790048 2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-model-cache\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:43:16.790176 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.790114 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvjdd\" (UniqueName: \"kubernetes.io/projected/3360608f-82fe-434c-92c9-238e4ac8c4a9-kube-api-access-cvjdd\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:43:16.790176 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.790124 2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-dshm\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:43:16.790176 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.790133 2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3360608f-82fe-434c-92c9-238e4ac8c4a9-tls-certs\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:43:16.790176 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.790142 2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3360608f-82fe-434c-92c9-238e4ac8c4a9-home\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:43:16.847535 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.847494 2561 generic.go:356] "Generic (PLEG): container finished" podID="3360608f-82fe-434c-92c9-238e4ac8c4a9" containerID="3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71" exitCode=0 Jul 13 07:43:16.847717 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.847553 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" Jul 13 07:43:16.847717 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.847577 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" event={"ID":"3360608f-82fe-434c-92c9-238e4ac8c4a9","Type":"ContainerDied","Data":"3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71"} Jul 13 07:43:16.847717 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.847622 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8" event={"ID":"3360608f-82fe-434c-92c9-238e4ac8c4a9","Type":"ContainerDied","Data":"b2f29d76af20a93131f809d7f9a117f1c268989284489ea6169c8aecd9ba27d4"} Jul 13 07:43:16.847717 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.847639 2561 scope.go:117] "RemoveContainer" containerID="3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71" Jul 13 07:43:16.857763 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.857737 2561 scope.go:117] "RemoveContainer" containerID="3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71" Jul 13 07:43:16.858137 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:43:16.858115 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71\": container with ID starting with 3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71 not found: ID does not exist" containerID="3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71" Jul 13 07:43:16.858207 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.858148 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71"} err="failed to get container status \"3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71\": rpc error: code = NotFound desc = could not find container \"3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71\": container with ID starting with 3a2d2424a4bac22dde82223f4107e23c2fd6c4737ed844b60ffd97b00dd20e71 not found: ID does not exist" Jul 13 07:43:16.870384 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.870344 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8"] Jul 13 07:43:16.874379 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:16.874344 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-7d46e0/test-model-7d46e0-kserve-958dd6b49-w47q8"] Jul 13 07:43:17.342411 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:17.342372 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3360608f-82fe-434c-92c9-238e4ac8c4a9" path="/var/lib/kubelet/pods/3360608f-82fe-434c-92c9-238e4ac8c4a9/volumes" Jul 13 07:43:48.919094 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:43:48.919035 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:44:01.810733 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:44:01.810687 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:44:10.626000 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:44:10.625953 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:44:24.025413 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:44:24.025367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:44:33.014083 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:44:33.014020 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:44:41.516799 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:44:41.516747 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:44:55.813362 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:44:55.813322 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:45:07.818912 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.818871 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj"] Jul 13 07:45:07.819405 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.819260 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3360608f-82fe-434c-92c9-238e4ac8c4a9" containerName="main" Jul 13 07:45:07.819405 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.819273 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3360608f-82fe-434c-92c9-238e4ac8c4a9" containerName="main" Jul 13 07:45:07.819405 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.819333 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3360608f-82fe-434c-92c9-238e4ac8c4a9" containerName="main" Jul 13 07:45:07.822564 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.822530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:07.826502 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.826469 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"auth-test-model-db7d2d-kserve-self-signed-certs\"" Jul 13 07:45:07.826681 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.826520 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"openshift-service-ca.crt\"" Jul 13 07:45:07.826681 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.826579 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"default-dockercfg-88xvx\"" Jul 13 07:45:07.826681 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.826627 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"kube-root-ca.crt\"" Jul 13 07:45:07.834863 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.834823 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj"] Jul 13 07:45:07.952997 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.952950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-home\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:07.953247 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.953012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-dshm\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:07.953247 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.953037 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm4s9\" (UniqueName: \"kubernetes.io/projected/2a89d150-11df-41d8-9006-4de083131d16-kube-api-access-gm4s9\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:07.953247 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.953134 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-model-cache\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:07.953247 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.953151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a89d150-11df-41d8-9006-4de083131d16-tls-certs\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:07.953247 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:07.953212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-tmp-dir\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.054336 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.054287 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-dshm\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.054521 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.054342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm4s9\" (UniqueName: \"kubernetes.io/projected/2a89d150-11df-41d8-9006-4de083131d16-kube-api-access-gm4s9\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.054521 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.054384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-model-cache\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.054521 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.054407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a89d150-11df-41d8-9006-4de083131d16-tls-certs\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.054521 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.054466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-tmp-dir\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.054521 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.054503 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-home\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.054883 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.054848 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-model-cache\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.054883 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.054882 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-home\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.055091 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.054936 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-tmp-dir\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.057007 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.056978 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-dshm\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.057175 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.057160 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a89d150-11df-41d8-9006-4de083131d16-tls-certs\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.063676 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.063647 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm4s9\" (UniqueName: \"kubernetes.io/projected/2a89d150-11df-41d8-9006-4de083131d16-kube-api-access-gm4s9\") pod \"auth-test-model-db7d2d-kserve-6d9b566475-zxgrj\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.133810 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.133710 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:08.285831 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.285805 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj"] Jul 13 07:45:08.288495 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:45:08.288462 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a89d150_11df_41d8_9006_4de083131d16.slice/crio-b6923681a074d577084b6972a0269281faf0a3312e6e526c24860857983a2e16 WatchSource:0}: Error finding container b6923681a074d577084b6972a0269281faf0a3312e6e526c24860857983a2e16: Status 404 returned error can't find the container with id b6923681a074d577084b6972a0269281faf0a3312e6e526c24860857983a2e16 Jul 13 07:45:08.377707 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.377668 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" event={"ID":"2a89d150-11df-41d8-9006-4de083131d16","Type":"ContainerStarted","Data":"095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb"} Jul 13 07:45:08.377707 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.377719 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" event={"ID":"2a89d150-11df-41d8-9006-4de083131d16","Type":"ContainerStarted","Data":"b6923681a074d577084b6972a0269281faf0a3312e6e526c24860857983a2e16"} Jul 13 07:45:08.396134 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:08.395999 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" podStartSLOduration=1.39597404 podStartE2EDuration="1.39597404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:45:08.394536321 +0000 UTC m=+1997.595313425" watchObservedRunningTime="2026-07-13 07:45:08.39597404 +0000 UTC m=+1997.596751059" Jul 13 07:45:11.125354 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:11.125313 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:45:18.133882 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:18.133822 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:18.134380 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:18.133902 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:18.146841 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:18.146811 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:18.434843 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:18.434757 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:45:54.617077 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:45:54.617027 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:46:09.715865 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:46:09.715825 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:46:27.235883 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:46:27.235796 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:46:43.622373 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:46:43.622326 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:46:51.394981 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:46:51.394945 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:46:51.398861 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:46:51.398834 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:46:51.400566 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:46:51.400542 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:46:51.404423 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:46:51.404400 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:46:57.223201 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:46:57.223157 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:47:14.135607 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:14.135566 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:47:28.033269 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:28.033229 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:47:38.874129 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:38.874092 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj"] Jul 13 07:47:40.926586 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:40.926544 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:47:51.714111 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:51.714069 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:47:53.895471 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:53.895402 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" podUID="2a89d150-11df-41d8-9006-4de083131d16" containerName="main" containerID="cri-o://095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb" gracePeriod=45 Jul 13 07:47:54.152170 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.152084 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:47:54.176835 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.176798 2561 generic.go:356] "Generic (PLEG): container finished" podID="2a89d150-11df-41d8-9006-4de083131d16" containerID="095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb" exitCode=0 Jul 13 07:47:54.177014 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.176869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" event={"ID":"2a89d150-11df-41d8-9006-4de083131d16","Type":"ContainerDied","Data":"095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb"} Jul 13 07:47:54.177014 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.176898 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" Jul 13 07:47:54.177014 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.176913 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj" event={"ID":"2a89d150-11df-41d8-9006-4de083131d16","Type":"ContainerDied","Data":"b6923681a074d577084b6972a0269281faf0a3312e6e526c24860857983a2e16"} Jul 13 07:47:54.177014 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.176940 2561 scope.go:117] "RemoveContainer" containerID="095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb" Jul 13 07:47:54.186618 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.186588 2561 scope.go:117] "RemoveContainer" containerID="095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb" Jul 13 07:47:54.186985 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:47:54.186961 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb\": container with ID starting with 095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb not found: ID does not exist" containerID="095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb" Jul 13 07:47:54.187048 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.186997 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb"} err="failed to get container status \"095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb\": rpc error: code = NotFound desc = could not find container \"095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb\": container with ID starting with 095c0c6d2710b804a14aa10f34fa3e13b7e669fa1863216cf6216219b4e893fb not found: ID does not exist" Jul 13 07:47:54.244539 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.244502 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a89d150-11df-41d8-9006-4de083131d16-tls-certs\") pod \"2a89d150-11df-41d8-9006-4de083131d16\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " Jul 13 07:47:54.244539 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.244542 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-tmp-dir\") pod \"2a89d150-11df-41d8-9006-4de083131d16\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " Jul 13 07:47:54.244781 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.244567 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-model-cache\") pod \"2a89d150-11df-41d8-9006-4de083131d16\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " Jul 13 07:47:54.244781 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.244599 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-dshm\") pod \"2a89d150-11df-41d8-9006-4de083131d16\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " Jul 13 07:47:54.244781 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.244648 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-home\") pod \"2a89d150-11df-41d8-9006-4de083131d16\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " Jul 13 07:47:54.244781 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.244688 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm4s9\" (UniqueName: \"kubernetes.io/projected/2a89d150-11df-41d8-9006-4de083131d16-kube-api-access-gm4s9\") pod \"2a89d150-11df-41d8-9006-4de083131d16\" (UID: \"2a89d150-11df-41d8-9006-4de083131d16\") " Jul 13 07:47:54.244981 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.244862 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a89d150-11df-41d8-9006-4de083131d16" (UID: "2a89d150-11df-41d8-9006-4de083131d16"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:47:54.244981 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.244873 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a89d150-11df-41d8-9006-4de083131d16" (UID: "2a89d150-11df-41d8-9006-4de083131d16"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:47:54.244981 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.244952 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-home" (OuterVolumeSpecName: "home") pod "2a89d150-11df-41d8-9006-4de083131d16" (UID: "2a89d150-11df-41d8-9006-4de083131d16"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:47:54.245160 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.245010 2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-tmp-dir\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:47:54.245160 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.245028 2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-model-cache\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:47:54.247179 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.247143 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a89d150-11df-41d8-9006-4de083131d16-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a89d150-11df-41d8-9006-4de083131d16" (UID: "2a89d150-11df-41d8-9006-4de083131d16"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:47:54.247304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.247143 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-dshm" (OuterVolumeSpecName: "dshm") pod "2a89d150-11df-41d8-9006-4de083131d16" (UID: "2a89d150-11df-41d8-9006-4de083131d16"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:47:54.247304 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.247183 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a89d150-11df-41d8-9006-4de083131d16-kube-api-access-gm4s9" (OuterVolumeSpecName: "kube-api-access-gm4s9") pod "2a89d150-11df-41d8-9006-4de083131d16" (UID: "2a89d150-11df-41d8-9006-4de083131d16"). InnerVolumeSpecName "kube-api-access-gm4s9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:47:54.345582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.345541 2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a89d150-11df-41d8-9006-4de083131d16-tls-certs\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:47:54.345582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.345571 2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-dshm\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:47:54.345582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.345579 2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a89d150-11df-41d8-9006-4de083131d16-home\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:47:54.345582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.345587 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm4s9\" (UniqueName: \"kubernetes.io/projected/2a89d150-11df-41d8-9006-4de083131d16-kube-api-access-gm4s9\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:47:54.497930 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.497889 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj"] Jul 13 07:47:54.501373 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:54.501332 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/auth-test-model-db7d2d-kserve-6d9b566475-zxgrj"] Jul 13 07:47:55.341877 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:55.341834 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a89d150-11df-41d8-9006-4de083131d16" path="/var/lib/kubelet/pods/2a89d150-11df-41d8-9006-4de083131d16/volumes" Jul 13 07:47:56.964144 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:56.964104 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl"] Jul 13 07:47:56.964565 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:56.964468 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a89d150-11df-41d8-9006-4de083131d16" containerName="main" Jul 13 07:47:56.964565 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:56.964480 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a89d150-11df-41d8-9006-4de083131d16" containerName="main" Jul 13 07:47:56.964565 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:56.964559 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a89d150-11df-41d8-9006-4de083131d16" containerName="main" Jul 13 07:47:56.967579 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:56.967551 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:56.971706 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:56.971668 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"openshift-service-ca.crt\"" Jul 13 07:47:56.972161 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:56.972133 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"sub-test-model-db7d2d-kserve-self-signed-certs\"" Jul 13 07:47:56.972161 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:56.972151 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"default-dockercfg-88xvx\"" Jul 13 07:47:56.972334 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:56.972165 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"kube-root-ca.crt\"" Jul 13 07:47:56.989573 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:56.989531 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl"] Jul 13 07:47:57.063668 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.063626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-home\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.063668 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.063671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-dshm\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.063944 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.063693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tls-certs\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.063944 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.063712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg694\" (UniqueName: \"kubernetes.io/projected/cc89ca81-3943-4ad2-a572-f4cc77c560ae-kube-api-access-lg694\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.063944 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.063821 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tmp-dir\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.063944 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.063864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-model-cache\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.164867 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.164817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-dshm\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.164867 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.164870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tls-certs\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.165164 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.164891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg694\" (UniqueName: \"kubernetes.io/projected/cc89ca81-3943-4ad2-a572-f4cc77c560ae-kube-api-access-lg694\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.165164 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.164933 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tmp-dir\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.165164 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.164954 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-model-cache\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.165164 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.165015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-home\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.165434 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.165401 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tmp-dir\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.165620 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.165451 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-home\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.165620 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.165505 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-model-cache\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.167591 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.167563 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-dshm\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.167774 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.167734 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tls-certs\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.173389 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.173354 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg694\" (UniqueName: \"kubernetes.io/projected/cc89ca81-3943-4ad2-a572-f4cc77c560ae-kube-api-access-lg694\") pod \"sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.277901 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.277753 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:47:57.430375 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:57.430296 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl"] Jul 13 07:47:57.432905 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:47:57.432875 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc89ca81_3943_4ad2_a572_f4cc77c560ae.slice/crio-0b920cd5d2a51b674cac7b56600b18e1826bbfa392bc286dd596f994ac398c70 WatchSource:0}: Error finding container 0b920cd5d2a51b674cac7b56600b18e1826bbfa392bc286dd596f994ac398c70: Status 404 returned error can't find the container with id 0b920cd5d2a51b674cac7b56600b18e1826bbfa392bc286dd596f994ac398c70 Jul 13 07:47:58.198404 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:58.198357 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" event={"ID":"cc89ca81-3943-4ad2-a572-f4cc77c560ae","Type":"ContainerStarted","Data":"6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41"} Jul 13 07:47:58.198404 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:58.198408 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" event={"ID":"cc89ca81-3943-4ad2-a572-f4cc77c560ae","Type":"ContainerStarted","Data":"0b920cd5d2a51b674cac7b56600b18e1826bbfa392bc286dd596f994ac398c70"} Jul 13 07:47:58.214430 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:47:58.214358 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" podStartSLOduration=2.21433516 podStartE2EDuration="2.21433516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:47:58.21379135 +0000 UTC m=+2167.414568375" watchObservedRunningTime="2026-07-13 07:47:58.21433516 +0000 UTC m=+2167.415112178" Jul 13 07:48:01.022134 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:01.022093 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:48:07.278020 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:07.277980 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:48:07.278500 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:07.278034 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:48:07.291009 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:07.290976 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:48:08.260687 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:08.260653 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:48:20.523510 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.523469 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9"] Jul 13 07:48:20.528724 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.528692 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.531303 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.531276 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"default-dockercfg-kwv9t\"" Jul 13 07:48:20.531462 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.531275 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"kube-root-ca.crt\"" Jul 13 07:48:20.532334 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.532313 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"openshift-service-ca.crt\"" Jul 13 07:48:20.532427 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.532348 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"sub-test-model-da56f9-kserve-self-signed-certs\"" Jul 13 07:48:20.540831 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.540790 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9"] Jul 13 07:48:20.564809 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.564772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-dshm\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.564809 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.564811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tmp-dir\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.565040 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.564868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-home\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.565040 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.564887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6j5f\" (UniqueName: \"kubernetes.io/projected/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-kube-api-access-m6j5f\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.565040 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.564958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tls-certs\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.565040 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.564992 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-model-cache\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.665651 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.665608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tls-certs\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.665651 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.665657 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-model-cache\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.665906 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.665702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-dshm\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.665906 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.665718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tmp-dir\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.665906 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.665756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-home\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.666051 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.665903 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6j5f\" (UniqueName: \"kubernetes.io/projected/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-kube-api-access-m6j5f\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.666146 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.666125 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-model-cache\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.666220 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.666198 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tmp-dir\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.666274 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.666224 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-home\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.668390 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.668362 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-dshm\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.668583 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.668564 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tls-certs\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.675991 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.675957 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6j5f\" (UniqueName: \"kubernetes.io/projected/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-kube-api-access-m6j5f\") pod \"sub-test-model-da56f9-kserve-64cd9585-hm7d9\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.839820 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.839707 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:20.986025 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:20.985959 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9"] Jul 13 07:48:20.989171 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:48:20.989135 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc2788d9_7b74_4b51_9e6d_1caab2b97efc.slice/crio-683a5b11d0503d649d81e2a5bed8c7dfa3a79da2139b2de075cf5ed26600b625 WatchSource:0}: Error finding container 683a5b11d0503d649d81e2a5bed8c7dfa3a79da2139b2de075cf5ed26600b625: Status 404 returned error can't find the container with id 683a5b11d0503d649d81e2a5bed8c7dfa3a79da2139b2de075cf5ed26600b625 Jul 13 07:48:21.310955 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:21.310915 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" event={"ID":"cc2788d9-7b74-4b51-9e6d-1caab2b97efc","Type":"ContainerStarted","Data":"4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647"} Jul 13 07:48:21.311148 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:21.310964 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" event={"ID":"cc2788d9-7b74-4b51-9e6d-1caab2b97efc","Type":"ContainerStarted","Data":"683a5b11d0503d649d81e2a5bed8c7dfa3a79da2139b2de075cf5ed26600b625"} Jul 13 07:48:21.327706 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:21.327649 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" podStartSLOduration=1.32763158 podStartE2EDuration="1.32763158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:48:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:48:21.326413288 +0000 UTC m=+2190.527190307" watchObservedRunningTime="2026-07-13 07:48:21.32763158 +0000 UTC m=+2190.528408597" Jul 13 07:48:24.224247 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:24.224207 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:48:30.840133 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:30.840092 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:30.840133 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:30.840145 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:30.853010 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:30.852982 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:31.370000 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:31.369968 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:48:38.239533 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:38.239490 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:48:57.116266 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:48:57.116215 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:49:01.262932 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:01.262889 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl"] Jul 13 07:49:02.201618 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:02.201567 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9"] Jul 13 07:49:13.350394 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:13.350301 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:49:16.284480 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.284412 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" podUID="cc89ca81-3943-4ad2-a572-f4cc77c560ae" containerName="main" containerID="cri-o://6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41" gracePeriod=45 Jul 13 07:49:16.558840 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.558807 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:49:16.578858 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.578817 2561 generic.go:356] "Generic (PLEG): container finished" podID="cc89ca81-3943-4ad2-a572-f4cc77c560ae" containerID="6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41" exitCode=0 Jul 13 07:49:16.578858 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.578869 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" Jul 13 07:49:16.579163 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.578904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" event={"ID":"cc89ca81-3943-4ad2-a572-f4cc77c560ae","Type":"ContainerDied","Data":"6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41"} Jul 13 07:49:16.579163 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.578988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl" event={"ID":"cc89ca81-3943-4ad2-a572-f4cc77c560ae","Type":"ContainerDied","Data":"0b920cd5d2a51b674cac7b56600b18e1826bbfa392bc286dd596f994ac398c70"} Jul 13 07:49:16.579163 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.579024 2561 scope.go:117] "RemoveContainer" containerID="6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41" Jul 13 07:49:16.588668 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.588639 2561 scope.go:117] "RemoveContainer" containerID="6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41" Jul 13 07:49:16.589045 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:49:16.589025 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41\": container with ID starting with 6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41 not found: ID does not exist" containerID="6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41" Jul 13 07:49:16.589141 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.589088 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41"} err="failed to get container status \"6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41\": rpc error: code = NotFound desc = could not find container \"6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41\": container with ID starting with 6108496ba3b1f825600e667531a11aa925f6d125f2fa683ee1a3581bfa578c41 not found: ID does not exist" Jul 13 07:49:16.683151 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683111 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg694\" (UniqueName: \"kubernetes.io/projected/cc89ca81-3943-4ad2-a572-f4cc77c560ae-kube-api-access-lg694\") pod \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " Jul 13 07:49:16.683339 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683161 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tmp-dir\") pod \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " Jul 13 07:49:16.683339 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683205 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-model-cache\") pod \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " Jul 13 07:49:16.683339 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683326 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-dshm\") pod \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " Jul 13 07:49:16.683452 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683398 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-home\") pod \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " Jul 13 07:49:16.683502 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683467 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "cc89ca81-3943-4ad2-a572-f4cc77c560ae" (UID: "cc89ca81-3943-4ad2-a572-f4cc77c560ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:49:16.683502 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683484 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cc89ca81-3943-4ad2-a572-f4cc77c560ae" (UID: "cc89ca81-3943-4ad2-a572-f4cc77c560ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:49:16.683612 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683475 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tls-certs\") pod \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\" (UID: \"cc89ca81-3943-4ad2-a572-f4cc77c560ae\") " Jul 13 07:49:16.683709 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683685 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-home" (OuterVolumeSpecName: "home") pod "cc89ca81-3943-4ad2-a572-f4cc77c560ae" (UID: "cc89ca81-3943-4ad2-a572-f4cc77c560ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:49:16.683896 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683875 2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tmp-dir\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:16.683967 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683899 2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-model-cache\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:16.683967 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.683909 2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-home\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:16.685624 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.685591 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-dshm" (OuterVolumeSpecName: "dshm") pod "cc89ca81-3943-4ad2-a572-f4cc77c560ae" (UID: "cc89ca81-3943-4ad2-a572-f4cc77c560ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:49:16.685744 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.685649 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc89ca81-3943-4ad2-a572-f4cc77c560ae-kube-api-access-lg694" (OuterVolumeSpecName: "kube-api-access-lg694") pod "cc89ca81-3943-4ad2-a572-f4cc77c560ae" (UID: "cc89ca81-3943-4ad2-a572-f4cc77c560ae"). InnerVolumeSpecName "kube-api-access-lg694". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:49:16.685890 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.685873 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cc89ca81-3943-4ad2-a572-f4cc77c560ae" (UID: "cc89ca81-3943-4ad2-a572-f4cc77c560ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:49:16.785031 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.784978 2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc89ca81-3943-4ad2-a572-f4cc77c560ae-dshm\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:16.785031 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.785023 2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc89ca81-3943-4ad2-a572-f4cc77c560ae-tls-certs\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:16.785031 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.785035 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg694\" (UniqueName: \"kubernetes.io/projected/cc89ca81-3943-4ad2-a572-f4cc77c560ae-kube-api-access-lg694\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:16.902454 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.902411 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl"] Jul 13 07:49:16.907261 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:16.907227 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/sub-test-model-db7d2d-kserve-f8c8d98f7-5qpxl"] Jul 13 07:49:17.225499 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.225456 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" podUID="cc2788d9-7b74-4b51-9e6d-1caab2b97efc" containerName="main" containerID="cri-o://4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647" gracePeriod=45 Jul 13 07:49:17.341791 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.341748 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc89ca81-3943-4ad2-a572-f4cc77c560ae" path="/var/lib/kubelet/pods/cc89ca81-3943-4ad2-a572-f4cc77c560ae/volumes" Jul 13 07:49:17.485005 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.484918 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:49:17.586232 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.586197 2561 generic.go:356] "Generic (PLEG): container finished" podID="cc2788d9-7b74-4b51-9e6d-1caab2b97efc" containerID="4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647" exitCode=0 Jul 13 07:49:17.586419 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.586246 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" Jul 13 07:49:17.586419 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.586287 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" event={"ID":"cc2788d9-7b74-4b51-9e6d-1caab2b97efc","Type":"ContainerDied","Data":"4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647"} Jul 13 07:49:17.586419 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.586333 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9" event={"ID":"cc2788d9-7b74-4b51-9e6d-1caab2b97efc","Type":"ContainerDied","Data":"683a5b11d0503d649d81e2a5bed8c7dfa3a79da2139b2de075cf5ed26600b625"} Jul 13 07:49:17.586419 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.586352 2561 scope.go:117] "RemoveContainer" containerID="4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647" Jul 13 07:49:17.591048 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.591016 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-dshm\") pod \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " Jul 13 07:49:17.591231 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.591123 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-model-cache\") pod \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " Jul 13 07:49:17.591231 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.591157 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tmp-dir\") pod \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " Jul 13 07:49:17.591231 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.591198 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tls-certs\") pod \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " Jul 13 07:49:17.591231 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.591224 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-home\") pod \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " Jul 13 07:49:17.591437 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.591267 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6j5f\" (UniqueName: \"kubernetes.io/projected/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-kube-api-access-m6j5f\") pod \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\" (UID: \"cc2788d9-7b74-4b51-9e6d-1caab2b97efc\") " Jul 13 07:49:17.591437 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.591381 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-model-cache" (OuterVolumeSpecName: "model-cache") pod "cc2788d9-7b74-4b51-9e6d-1caab2b97efc" (UID: "cc2788d9-7b74-4b51-9e6d-1caab2b97efc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:49:17.591541 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.591498 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cc2788d9-7b74-4b51-9e6d-1caab2b97efc" (UID: "cc2788d9-7b74-4b51-9e6d-1caab2b97efc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:49:17.591541 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.591523 2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-model-cache\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:17.592080 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.592001 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-home" (OuterVolumeSpecName: "home") pod "cc2788d9-7b74-4b51-9e6d-1caab2b97efc" (UID: "cc2788d9-7b74-4b51-9e6d-1caab2b97efc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:49:17.593650 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.593616 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cc2788d9-7b74-4b51-9e6d-1caab2b97efc" (UID: "cc2788d9-7b74-4b51-9e6d-1caab2b97efc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:49:17.593650 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.593630 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-dshm" (OuterVolumeSpecName: "dshm") pod "cc2788d9-7b74-4b51-9e6d-1caab2b97efc" (UID: "cc2788d9-7b74-4b51-9e6d-1caab2b97efc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:49:17.593809 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.593671 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-kube-api-access-m6j5f" (OuterVolumeSpecName: "kube-api-access-m6j5f") pod "cc2788d9-7b74-4b51-9e6d-1caab2b97efc" (UID: "cc2788d9-7b74-4b51-9e6d-1caab2b97efc"). InnerVolumeSpecName "kube-api-access-m6j5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:49:17.596046 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.596020 2561 scope.go:117] "RemoveContainer" containerID="4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647" Jul 13 07:49:17.596439 ip-10-0-132-188 kubenswrapper[2561]: E0713 07:49:17.596412 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647\": container with ID starting with 4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647 not found: ID does not exist" containerID="4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647" Jul 13 07:49:17.596548 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.596448 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647"} err="failed to get container status \"4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647\": rpc error: code = NotFound desc = could not find container \"4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647\": container with ID starting with 4036f893d404f6bcb4bcb960b7166bf09c0fc6b3401f39ea89c473a0e1510647 not found: ID does not exist" Jul 13 07:49:17.692940 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.692898 2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tmp-dir\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:17.692940 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.692935 2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-tls-certs\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:17.692940 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.692943 2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-home\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:17.692940 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.692952 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6j5f\" (UniqueName: \"kubernetes.io/projected/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-kube-api-access-m6j5f\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:17.693265 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.692961 2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2788d9-7b74-4b51-9e6d-1caab2b97efc-dshm\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:49:17.916073 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.914929 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9"] Jul 13 07:49:17.916073 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:17.914998 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/sub-test-model-da56f9-kserve-64cd9585-hm7d9"] Jul 13 07:49:19.340768 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:19.340725 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc2788d9-7b74-4b51-9e6d-1caab2b97efc" path="/var/lib/kubelet/pods/cc2788d9-7b74-4b51-9e6d-1caab2b97efc/volumes" Jul 13 07:49:32.824905 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.824865 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l"] Jul 13 07:49:32.825483 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.825214 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2788d9-7b74-4b51-9e6d-1caab2b97efc" containerName="main" Jul 13 07:49:32.825483 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.825227 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2788d9-7b74-4b51-9e6d-1caab2b97efc" containerName="main" Jul 13 07:49:32.825483 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.825240 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc89ca81-3943-4ad2-a572-f4cc77c560ae" containerName="main" Jul 13 07:49:32.825483 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.825245 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc89ca81-3943-4ad2-a572-f4cc77c560ae" containerName="main" Jul 13 07:49:32.825483 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.825307 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc2788d9-7b74-4b51-9e6d-1caab2b97efc" containerName="main" Jul 13 07:49:32.825483 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.825317 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc89ca81-3943-4ad2-a572-f4cc77c560ae" containerName="main" Jul 13 07:49:32.828247 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.828225 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:32.831904 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.831876 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"openshift-service-ca.crt\"" Jul 13 07:49:32.831904 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.831896 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"rate-test-model-da56f9-kserve-self-signed-certs\"" Jul 13 07:49:32.832177 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.831881 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"kube-root-ca.crt\"" Jul 13 07:49:32.832177 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.831881 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"default-dockercfg-kwv9t\"" Jul 13 07:49:32.839619 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.839587 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l"] Jul 13 07:49:32.929568 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.929530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tls-certs\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:32.929772 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.929604 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-dshm\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:32.929772 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.929632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tmp-dir\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:32.929772 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.929671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-home\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:32.929772 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.929756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-model-cache\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:32.929943 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:32.929794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85pxj\" (UniqueName: \"kubernetes.io/projected/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-kube-api-access-85pxj\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.030448 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.030410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-dshm\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.030448 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.030454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tmp-dir\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.030673 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.030570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-home\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.030673 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.030635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-model-cache\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.030766 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.030669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85pxj\" (UniqueName: \"kubernetes.io/projected/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-kube-api-access-85pxj\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.030766 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.030712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tls-certs\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.030871 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.030811 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tmp-dir\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.030970 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.030943 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-home\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.031049 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.031011 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-model-cache\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.033203 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.033145 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-dshm\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.033828 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.033800 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tls-certs\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.040003 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.039976 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85pxj\" (UniqueName: \"kubernetes.io/projected/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-kube-api-access-85pxj\") pod \"rate-test-model-da56f9-kserve-7b8688dcbc-fk44l\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.138357 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.138244 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:33.282316 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.282286 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l"] Jul 13 07:49:33.284968 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:49:33.284945 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58d1fd6e_a236_4f76_97b8_8f1b0f5edada.slice/crio-64e06e7df44c81e16e539fb1cd933106502396dbc85776552275c266c45975ee WatchSource:0}: Error finding container 64e06e7df44c81e16e539fb1cd933106502396dbc85776552275c266c45975ee: Status 404 returned error can't find the container with id 64e06e7df44c81e16e539fb1cd933106502396dbc85776552275c266c45975ee Jul 13 07:49:33.662707 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.662667 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" event={"ID":"58d1fd6e-a236-4f76-97b8-8f1b0f5edada","Type":"ContainerStarted","Data":"fc2751cc65db8f0dbcd299ab9533142cfc39476fbf3bc13bb6ecf4dad6c12822"} Jul 13 07:49:33.662707 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.662712 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" event={"ID":"58d1fd6e-a236-4f76-97b8-8f1b0f5edada","Type":"ContainerStarted","Data":"64e06e7df44c81e16e539fb1cd933106502396dbc85776552275c266c45975ee"} Jul 13 07:49:33.681300 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:33.681240 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" podStartSLOduration=1.681220772 podStartE2EDuration="1.681220772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:49:33.679517209 +0000 UTC m=+2262.880294229" watchObservedRunningTime="2026-07-13 07:49:33.681220772 +0000 UTC m=+2262.881997847" Jul 13 07:49:36.924960 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:36.924917 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:49:43.138947 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:43.138896 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:43.139408 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:43.138968 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:43.152229 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:43.152196 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:43.723413 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:43.723375 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:49:50.781223 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:49:50.781179 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:50:11.123582 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:11.123538 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:50:16.752353 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:16.752318 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l"] Jul 13 07:50:23.127374 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:23.127330 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:50:31.773430 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:31.773368 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" podUID="58d1fd6e-a236-4f76-97b8-8f1b0f5edada" containerName="main" containerID="cri-o://fc2751cc65db8f0dbcd299ab9533142cfc39476fbf3bc13bb6ecf4dad6c12822" gracePeriod=45 Jul 13 07:50:31.935494 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:31.935451 2561 generic.go:356] "Generic (PLEG): container finished" podID="58d1fd6e-a236-4f76-97b8-8f1b0f5edada" containerID="fc2751cc65db8f0dbcd299ab9533142cfc39476fbf3bc13bb6ecf4dad6c12822" exitCode=0 Jul 13 07:50:31.935730 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:31.935496 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" event={"ID":"58d1fd6e-a236-4f76-97b8-8f1b0f5edada","Type":"ContainerDied","Data":"fc2751cc65db8f0dbcd299ab9533142cfc39476fbf3bc13bb6ecf4dad6c12822"} Jul 13 07:50:32.035392 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.035301 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:50:32.035746 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.035729 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85pxj\" (UniqueName: \"kubernetes.io/projected/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-kube-api-access-85pxj\") pod \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " Jul 13 07:50:32.035813 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.035782 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-model-cache\") pod \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " Jul 13 07:50:32.035883 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.035819 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-dshm\") pod \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " Jul 13 07:50:32.035883 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.035857 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tls-certs\") pod \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " Jul 13 07:50:32.035991 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.035887 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-home\") pod \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " Jul 13 07:50:32.035991 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.035918 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tmp-dir\") pod \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\" (UID: \"58d1fd6e-a236-4f76-97b8-8f1b0f5edada\") " Jul 13 07:50:32.036221 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.036158 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-model-cache" (OuterVolumeSpecName: "model-cache") pod "58d1fd6e-a236-4f76-97b8-8f1b0f5edada" (UID: "58d1fd6e-a236-4f76-97b8-8f1b0f5edada"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:50:32.036337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.036254 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-home" (OuterVolumeSpecName: "home") pod "58d1fd6e-a236-4f76-97b8-8f1b0f5edada" (UID: "58d1fd6e-a236-4f76-97b8-8f1b0f5edada"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:50:32.036337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.036279 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58d1fd6e-a236-4f76-97b8-8f1b0f5edada" (UID: "58d1fd6e-a236-4f76-97b8-8f1b0f5edada"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:50:32.036337 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.036303 2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-model-cache\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:50:32.038235 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.038201 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58d1fd6e-a236-4f76-97b8-8f1b0f5edada" (UID: "58d1fd6e-a236-4f76-97b8-8f1b0f5edada"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:50:32.038235 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.038203 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-dshm" (OuterVolumeSpecName: "dshm") pod "58d1fd6e-a236-4f76-97b8-8f1b0f5edada" (UID: "58d1fd6e-a236-4f76-97b8-8f1b0f5edada"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:50:32.038235 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.038231 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-kube-api-access-85pxj" (OuterVolumeSpecName: "kube-api-access-85pxj") pod "58d1fd6e-a236-4f76-97b8-8f1b0f5edada" (UID: "58d1fd6e-a236-4f76-97b8-8f1b0f5edada"). InnerVolumeSpecName "kube-api-access-85pxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:50:32.137008 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.136969 2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tls-certs\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:50:32.137008 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.137002 2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-home\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:50:32.137008 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.137011 2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-tmp-dir\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:50:32.137008 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.137019 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85pxj\" (UniqueName: \"kubernetes.io/projected/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-kube-api-access-85pxj\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:50:32.137320 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.137027 2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58d1fd6e-a236-4f76-97b8-8f1b0f5edada-dshm\") on node \"ip-10-0-132-188.ec2.internal\" DevicePath \"\"" Jul 13 07:50:32.942128 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.942095 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" Jul 13 07:50:32.942583 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.942124 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l" event={"ID":"58d1fd6e-a236-4f76-97b8-8f1b0f5edada","Type":"ContainerDied","Data":"64e06e7df44c81e16e539fb1cd933106502396dbc85776552275c266c45975ee"} Jul 13 07:50:32.942583 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.942178 2561 scope.go:117] "RemoveContainer" containerID="fc2751cc65db8f0dbcd299ab9533142cfc39476fbf3bc13bb6ecf4dad6c12822" Jul 13 07:50:32.965286 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.965244 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l"] Jul 13 07:50:32.969973 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:32.969938 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/rate-test-model-da56f9-kserve-7b8688dcbc-fk44l"] Jul 13 07:50:33.341852 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:50:33.341812 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58d1fd6e-a236-4f76-97b8-8f1b0f5edada" path="/var/lib/kubelet/pods/58d1fd6e-a236-4f76-97b8-8f1b0f5edada/volumes" Jul 13 07:51:07.999539 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:07.999492 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dhnkc"] Jul 13 07:51:14.578101 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:14.578047 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-jhrcd_1fc7badd-599b-4563-9a24-88900f32c9df/copy-manifests/0.log" Jul 13 07:51:14.585962 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:14.585927 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-jhrcd_1fc7badd-599b-4563-9a24-88900f32c9df/manager/0.log" Jul 13 07:51:16.875545 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:16.875507 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dhnkc_31375aeb-1d09-419d-ad58-81025a2c49ec/limitador/0.log" Jul 13 07:51:17.462493 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:17.462449 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lc75f_06b150c3-5d0f-4a71-ad42-d6f50c3dbfad/discovery/0.log" Jul 13 07:51:18.180960 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:18.180923 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bb4754dc8-h5xv7_f63c2209-ae62-4ed9-ae55-d0cf4a26b496/router/0.log" Jul 13 07:51:18.543339 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:18.543304 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-jxr46_b2a5ee92-f826-489a-b29c-b73dac53736f/main/0.log" Jul 13 07:51:18.789922 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:18.789889 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-h5xgd_7293bc1b-8cd2-4e80-ac80-0f3f596af2e2/main/0.log" Jul 13 07:51:23.116341 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.116304 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tzdq9/must-gather-mrxrf"] Jul 13 07:51:23.116834 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.116652 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d1fd6e-a236-4f76-97b8-8f1b0f5edada" containerName="main" Jul 13 07:51:23.116834 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.116663 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d1fd6e-a236-4f76-97b8-8f1b0f5edada" containerName="main" Jul 13 07:51:23.116834 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.116731 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="58d1fd6e-a236-4f76-97b8-8f1b0f5edada" containerName="main" Jul 13 07:51:23.120123 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.120089 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzdq9/must-gather-mrxrf" Jul 13 07:51:23.124871 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.124847 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tzdq9\"/\"default-dockercfg-ngqlr\"" Jul 13 07:51:23.125020 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.124847 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzdq9\"/\"kube-root-ca.crt\"" Jul 13 07:51:23.125455 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.125433 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzdq9\"/\"openshift-service-ca.crt\"" Jul 13 07:51:23.130634 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.130610 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzdq9/must-gather-mrxrf"] Jul 13 07:51:23.191544 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.191482 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd75c\" (UniqueName: \"kubernetes.io/projected/aec1cb99-9474-45de-8abe-61c6beea5f2e-kube-api-access-qd75c\") pod \"must-gather-mrxrf\" (UID: \"aec1cb99-9474-45de-8abe-61c6beea5f2e\") " pod="openshift-must-gather-tzdq9/must-gather-mrxrf" Jul 13 07:51:23.191742 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.191603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aec1cb99-9474-45de-8abe-61c6beea5f2e-must-gather-output\") pod \"must-gather-mrxrf\" (UID: \"aec1cb99-9474-45de-8abe-61c6beea5f2e\") " pod="openshift-must-gather-tzdq9/must-gather-mrxrf" Jul 13 07:51:23.292247 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.292201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd75c\" (UniqueName: \"kubernetes.io/projected/aec1cb99-9474-45de-8abe-61c6beea5f2e-kube-api-access-qd75c\") pod \"must-gather-mrxrf\" (UID: \"aec1cb99-9474-45de-8abe-61c6beea5f2e\") " pod="openshift-must-gather-tzdq9/must-gather-mrxrf" Jul 13 07:51:23.292247 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.292260 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aec1cb99-9474-45de-8abe-61c6beea5f2e-must-gather-output\") pod \"must-gather-mrxrf\" (UID: \"aec1cb99-9474-45de-8abe-61c6beea5f2e\") " pod="openshift-must-gather-tzdq9/must-gather-mrxrf" Jul 13 07:51:23.292620 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.292604 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aec1cb99-9474-45de-8abe-61c6beea5f2e-must-gather-output\") pod \"must-gather-mrxrf\" (UID: \"aec1cb99-9474-45de-8abe-61c6beea5f2e\") " pod="openshift-must-gather-tzdq9/must-gather-mrxrf" Jul 13 07:51:23.302353 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.302317 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd75c\" (UniqueName: \"kubernetes.io/projected/aec1cb99-9474-45de-8abe-61c6beea5f2e-kube-api-access-qd75c\") pod \"must-gather-mrxrf\" (UID: \"aec1cb99-9474-45de-8abe-61c6beea5f2e\") " pod="openshift-must-gather-tzdq9/must-gather-mrxrf" Jul 13 07:51:23.431942 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.431848 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzdq9/must-gather-mrxrf" Jul 13 07:51:23.573710 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.573674 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzdq9/must-gather-mrxrf"] Jul 13 07:51:23.577240 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:51:23.577204 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaec1cb99_9474_45de_8abe_61c6beea5f2e.slice/crio-d820e022b4e2dc21dbd1252373e9130d5afb155041a3606ca3f56df53544f1c9 WatchSource:0}: Error finding container d820e022b4e2dc21dbd1252373e9130d5afb155041a3606ca3f56df53544f1c9: Status 404 returned error can't find the container with id d820e022b4e2dc21dbd1252373e9130d5afb155041a3606ca3f56df53544f1c9 Jul 13 07:51:23.579250 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:23.579231 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 07:51:24.196093 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:24.196027 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzdq9/must-gather-mrxrf" event={"ID":"aec1cb99-9474-45de-8abe-61c6beea5f2e","Type":"ContainerStarted","Data":"d820e022b4e2dc21dbd1252373e9130d5afb155041a3606ca3f56df53544f1c9"} Jul 13 07:51:25.205585 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:25.205539 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzdq9/must-gather-mrxrf" event={"ID":"aec1cb99-9474-45de-8abe-61c6beea5f2e","Type":"ContainerStarted","Data":"16a3987423ca9e8b31882c71255d7b1081ed35edb25deb42d6a8095d596b1352"} Jul 13 07:51:25.206099 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:25.205601 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzdq9/must-gather-mrxrf" event={"ID":"aec1cb99-9474-45de-8abe-61c6beea5f2e","Type":"ContainerStarted","Data":"e345f90d3f5f50fda245124bd574ef536f4e9d3f8dbaced2eedbf8c6128583ed"} Jul 13 07:51:25.224262 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:25.224193 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tzdq9/must-gather-mrxrf" podStartSLOduration=1.371816239 podStartE2EDuration="2.224171085s" totalImagesPullingTime="852.354846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:51:25.223798935 +0000 UTC m=+2374.424575961" watchObservedRunningTime="2026-07-13 07:51:25.224171085 +0000 UTC m=+2374.424948104" Jul 13 07:51:26.124328 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:26.124291 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9qtcc_f25f49d9-494c-4db9-a4ab-4dc4b84dab74/global-pull-secret-syncer/0.log" Jul 13 07:51:26.267892 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:26.267853 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gtwrh_4632d1eb-0ae2-467d-9f9a-ff61dae76ec2/konnectivity-agent/0.log" Jul 13 07:51:26.363077 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:26.363026 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-188.ec2.internal_5c35be48bf00c794e91171a7db468cf0/haproxy/0.log" Jul 13 07:51:32.223495 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:32.223463 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dhnkc_31375aeb-1d09-419d-ad58-81025a2c49ec/limitador/0.log" Jul 13 07:51:34.140221 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:34.140178 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-fkv55_3ed22a84-eb0a-4525-b810-8635e11a5489/cluster-monitoring-operator/0.log" Jul 13 07:51:34.444236 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:34.444150 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qldd_d06a3d00-f8b0-4d77-9518-50eba8c992d6/node-exporter/0.log" Jul 13 07:51:34.475560 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:34.475526 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qldd_d06a3d00-f8b0-4d77-9518-50eba8c992d6/kube-rbac-proxy/0.log" Jul 13 07:51:34.504084 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:34.504029 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qldd_d06a3d00-f8b0-4d77-9518-50eba8c992d6/init-textfile/0.log" Jul 13 07:51:36.247705 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.247658 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg"] Jul 13 07:51:36.252965 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.252926 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.263783 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.263741 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg"] Jul 13 07:51:36.328048 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.328005 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-proc\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.328297 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.328126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lc4z\" (UniqueName: \"kubernetes.io/projected/00768d3f-4918-40db-a279-0c03346a27c7-kube-api-access-4lc4z\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.328297 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.328176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-sys\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.328297 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.328217 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-podres\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.328443 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.328291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-lib-modules\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.429361 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.429322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-proc\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.429602 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.429576 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-proc\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.429747 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.429710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lc4z\" (UniqueName: \"kubernetes.io/projected/00768d3f-4918-40db-a279-0c03346a27c7-kube-api-access-4lc4z\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.429869 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.429856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-sys\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.430085 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.430052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-podres\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.430227 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.430207 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-podres\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.430289 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.429997 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-sys\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.430368 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.430353 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-lib-modules\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.430500 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.430420 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00768d3f-4918-40db-a279-0c03346a27c7-lib-modules\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.439908 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.439868 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lc4z\" (UniqueName: \"kubernetes.io/projected/00768d3f-4918-40db-a279-0c03346a27c7-kube-api-access-4lc4z\") pod \"perf-node-gather-daemonset-lppzg\" (UID: \"00768d3f-4918-40db-a279-0c03346a27c7\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.569116 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.568977 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:36.597374 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.597343 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-4j2hm_0145d54b-4d41-49a0-b0e0-7099ddcd9095/networking-console-plugin/0.log" Jul 13 07:51:36.779893 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:36.779576 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg"] Jul 13 07:51:36.783798 ip-10-0-132-188 kubenswrapper[2561]: W0713 07:51:36.783752 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod00768d3f_4918_40db_a279_0c03346a27c7.slice/crio-4b19afc3f3865de8e3e665f8411c9a215f78f9c0c76479333b592ba3f97decb8 WatchSource:0}: Error finding container 4b19afc3f3865de8e3e665f8411c9a215f78f9c0c76479333b592ba3f97decb8: Status 404 returned error can't find the container with id 4b19afc3f3865de8e3e665f8411c9a215f78f9c0c76479333b592ba3f97decb8 Jul 13 07:51:37.279252 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:37.279223 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:51:37.286759 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:37.286723 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/2.log" Jul 13 07:51:37.295678 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:37.295631 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" event={"ID":"00768d3f-4918-40db-a279-0c03346a27c7","Type":"ContainerStarted","Data":"6f195622f1a8d1011ed9c6563f7d9c9fd52758ee25faf2843cca1cc7381d680e"} Jul 13 07:51:37.295892 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:37.295703 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" event={"ID":"00768d3f-4918-40db-a279-0c03346a27c7","Type":"ContainerStarted","Data":"4b19afc3f3865de8e3e665f8411c9a215f78f9c0c76479333b592ba3f97decb8"} Jul 13 07:51:37.296183 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:37.296161 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:37.315629 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:37.314648 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" podStartSLOduration=1.3146227750000001 podStartE2EDuration="1.314622775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:51:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:51:37.312879282 +0000 UTC m=+2386.513656348" watchObservedRunningTime="2026-07-13 07:51:37.314622775 +0000 UTC m=+2386.515399794" Jul 13 07:51:37.832029 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:37.831988 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-bft64_8c4c8cd3-1761-4ec9-bfd3-7fcf606b91d3/download-server/0.log" Jul 13 07:51:38.484805 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:38.484720 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-pgdxz_1cf4de98-d62f-4c5b-8d83-a66721c950d1/volume-data-source-validator/0.log" Jul 13 07:51:39.649439 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:39.649410 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-76h2t_52117e3a-733a-4799-939e-c8eeaa7f2c0d/dns/0.log" Jul 13 07:51:39.678493 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:39.678453 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-76h2t_52117e3a-733a-4799-939e-c8eeaa7f2c0d/kube-rbac-proxy/0.log" Jul 13 07:51:39.759512 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:39.759479 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2n9c_4b19fff5-4887-4c03-b55e-d3ce73693c53/dns-node-resolver/0.log" Jul 13 07:51:40.537362 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:40.537332 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wstkx_447beb12-e780-49da-bf7a-09ecc1ddb5ee/node-ca/0.log" Jul 13 07:51:41.706693 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:41.706652 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lc75f_06b150c3-5d0f-4a71-ad42-d6f50c3dbfad/discovery/0.log" Jul 13 07:51:41.946820 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:41.946793 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bb4754dc8-h5xv7_f63c2209-ae62-4ed9-ae55-d0cf4a26b496/router/0.log" Jul 13 07:51:42.686791 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:42.686753 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2htcq_e9db3791-7a75-4fe4-9948-311b6be55d1b/serve-healthcheck-canary/0.log" Jul 13 07:51:43.290116 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:43.290076 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rxz9h_9452bd9c-8b2d-4890-ae49-63a71ff19332/insights-operator/0.log" Jul 13 07:51:43.292420 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:43.292392 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rxz9h_9452bd9c-8b2d-4890-ae49-63a71ff19332/insights-operator/1.log" Jul 13 07:51:43.312248 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:43.312217 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-lppzg" Jul 13 07:51:43.554049 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:43.553945 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4bmz_2fc2478d-9e86-4364-8c04-4e7f20563244/kube-rbac-proxy/0.log" Jul 13 07:51:43.602945 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:43.602914 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4bmz_2fc2478d-9e86-4364-8c04-4e7f20563244/exporter/0.log" Jul 13 07:51:43.650781 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:43.650751 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4bmz_2fc2478d-9e86-4364-8c04-4e7f20563244/extractor/0.log" Jul 13 07:51:46.658950 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:46.658818 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-jhrcd_1fc7badd-599b-4563-9a24-88900f32c9df/manager/0.log" Jul 13 07:51:46.687616 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:46.687589 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-jhrcd_1fc7badd-599b-4563-9a24-88900f32c9df/copy-manifests/0.log" Jul 13 07:51:47.845776 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:47.845731 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lc75f_06b150c3-5d0f-4a71-ad42-d6f50c3dbfad/discovery/0.log" Jul 13 07:51:48.011098 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:48.011043 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bb4754dc8-h5xv7_f63c2209-ae62-4ed9-ae55-d0cf4a26b496/router/0.log" Jul 13 07:51:48.311857 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:48.311743 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67b5465ff8-w5vzl_e1d50726-09a3-4c73-ad77-e8ae69146804/manager/0.log" Jul 13 07:51:49.321596 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:49.321558 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lc75f_06b150c3-5d0f-4a71-ad42-d6f50c3dbfad/discovery/0.log" Jul 13 07:51:49.481348 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:49.481313 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bb4754dc8-h5xv7_f63c2209-ae62-4ed9-ae55-d0cf4a26b496/router/0.log" Jul 13 07:51:51.426025 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:51.425997 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:51:51.431405 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:51.431367 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-29tl4_72183be4-cff0-4144-82bf-9f2eb4e4f463/console-operator/1.log" Jul 13 07:51:51.438170 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:51.438124 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log" Jul 13 07:51:51.446792 ip-10-0-132-188 kubenswrapper[2561]: I0713 07:51:51.446765 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8424l_e7a8e5df-db0c-4345-84ab-bd237a9520f1/ovn-acl-logging/0.log"